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ABSTRACT 

This publication reviews the mathematical laboratory 
from three perspectives; a practical view of laboratories in 
operation, a review of related research, and a view of current 
laboratory evaluation procedures. After a discussion of definitions, 
types, and purposes of math labS; the ^irst paper concentrates on 
their historical development in Philadelphia, Pennsylvania, from 
their inception in 1967 through 1972. Despite continued interest 
throughout this period, actual numbers declined rapidly after 1970. 
Several reasons for this decline are cited. Several projects are 
reviewed; specifically discussed are problems, solutions, and 
results. Although generally pessimistic regarding the future of math 
labs, the author mentions several innovative movements as possible 
reversing trends. The second paper reviews research on math labs and 
activity learning, describes ways to employ math labs most 
effectively, and discusses some apparent effects on student 
achievement and attitudes (specifically, achievement gains in less 
able elementary children, with no effect on attitudes). This paper is 
followed by an extensive bibliography. The third paper critically 
analyzes seven specific project evaluations— their data collection 
techniques, types of analyses, and results. Following a discussion of 
difficulties encountered, the author makes some suggestions, based on 
the need for individually tailored evaluations. (CR) 
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Mathomatlcs Education Report? 

Mathenuitics Kducation Hcports are belnt; devo loped tc dl88omlnat« 

Intomutlou concerning mathunuitics education documents analyzed at 

the IIRIC Iniocmation Analysis Center for Science, MathematiCB> and 

KnvLroitnwntal Education* Those reports fall into three broad 

categories* Research reviews sunnnarize and analyze recent research 

in spec i lie areas o£ mat hematic a education. Resource guides identify 

and analyze materials and references for use by mathematics teachers 

at all levels. Special bibliographies announce the availability of 

ducumLmts and review the literature in selected interest areas of 

mathematics i.*ducation« Reports In each of these categories may also 

bo tar^;oted for specific sub-populatloni of the mathematics education 

cummimlty. Priorities for the developroent of future Mathematics 

Education Reports are established by ':be advisory board of the Center, 

in cooperation with the National Council of Teachers of Mathematics, 

the Sp>?cial Interest Group for Rescarc.i in Mathematics Education, the 

Conference Board of the Mathematical Sciences, and other professional 

^roupt. in mathematics education* Individual comments on past Reports 

and sii>;gestions for future Reports are always welcomed by the editor* 

Jon L. Higgins 
Editor 



This publication was prepared pursuant to a contract with the 
National Institute of Education, U.S. Department of Health, Education 
and Welfare. Contractors undertaking such projects under Government 
sponsorship arc encouraged to express freely their judgment in 
professional and technical matters. Points of view or opinions do not, 
therefore, necessarily represent official National Institute of Education 
position or policy* 



Papevs in this publication dcvulopod out of a symposium on 
resoacch pertaining to mathematics laboratories for the 1972 Annual 
Meeting of the National Council of TeachcrB of Mathematics* I was 
pleased to have the opportunity to orManiae that Byroposium* Iliu 
concepts underlying mathematica laboratories are so pervasive today 
that careful assessment , research and evaluation is becoming very 
important* 

To provide balance in the presentations, we requested three 
quite different papers: one to present a schoolman's practical view 
of laboratories, one to review related research, and one to revitw 
evaluation procedures* 

Alan Bai'son was appropriate to write the schoolman's paper for, 
as the Madison Ptoject coordinator in Philadelphia for several years, 
he was in a position to witness a wide variety of successes and failures* 

Professor Jack Wilkenson was asked to write the second paper 
because he had recently completed his doctoral thesis and was still 
in possession of his sensitive antenna which one develops during 
such a period* 

The final paper was written by Professor Donald Kerr who, with 
his colleague Professor John I.eBlanc, was Just embarking on the 
development of a new teacher training program. In preparation for 
that effort, they visited many laboratory projects and were particularly 
prepared to write on this subject. 

These papers offer a significant contribution to the literature 

of mathematics education* Wl)en we compare what we write today with 

the message of E* il* Moore in 1902, we can see an occasional advancement* 

After all, E* U* Moore didn't know what a Cuisenairo rod was* 

William M. Fitzgerald 
Fklktor 
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. A SCHOOLMAN'S VIHW OF THE HISTORICAL DEVELOPMENT AND CHANGE OF 
THE M^UHETUTICS UfiORATORY IN A LARGE URBAN SCHOOL SYSTEM 

Befor(5 we dlscusa the geneals, metamorphoais, and paralysis of the 
mathematics laboratory movement In Philadelphia, some definitions need to 
be clarified at the beginning: 

I. Characteristics of a Math Lab — In general » a mathematics labora- 
tory Is activity-centered; the child Is placed In a problem-solving 
situation and through self -exploration and discovery provides a 
solution based on his experiences, needs, and Interests. Below 
are listed some common bonds of mathematics laboratories. 

a. The room Is organized with stations of activities where 

the children (Individually, In small groups, or as an entire 
class) may work simultaneously on different materials or on 
the sam<^ materials at different rates. 

b. The room Is rich In materials* making use of commercial, 
teacher-made« and pupll-made devices. 

c. The teacher works with small groups, with Individuals, or 
with the entire class In a child-centered rather than a 
teacher-dominated atmosphere. 

d. The activities are usually open-ended to enable the students 
to extend their discoveries as far as they wish. 

e. The organisation of the laboratory work Is flexible so that 
a child can move from one activity to another, depending on 
his Interests and needs. 

f . There Is a multimedia or multlsensory approach to learning, 
using tapes, films, concrete objects, records, listening 
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centers, and so forth* 
g. Textbooks and po&phlete are used as reference mafeflals. 
They are mostly ungraded and include a large variety of 
topics* 

Basically there are four types of uuithematics laboratories; 
1« Decentralized, or classroom laboratories 

a. All claaarooms containing laboratories 

b. Some classrooms containing laboratories 

2. Centralised laboratory 

3. Team-room laboratory 

4* Roving, or movable, laboratory 
Following Is a brief description of each type; 

1. A decentralised laboratory provides a good situation in 
which the teacher has a permanent mathraatics laboratory 
in his room. This is ideal because the teacher is respon- 
sible for all areas of the cutriculuu and for a major por- 
tion of the time the child is in school. This oi*ganisation 
facilitates movement and scheduling (which is a problem with 
the other types of laboratories). It also allows the children 
and the teacher to use the material whenever the need arises* 
A variation can be adopted when it is too expensive to sup- 
ply all teachers with the materials, or when it is desirable 
to make use of any special talents of teachers. In this 
situation, several teachers join together and cycle the classes 
for mathematics instruction into one room. The teacher for 
that room, which la equipped with the laboratory, is then 
responsible for the mathematics instruction for all the 
children in the cycle* 
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2i Centrallied mathematics laboratories are used In many 
schools where children from all the grades* or from 
certain grades* share the facilities of the laboratory for 
part of their mathematics instruction* The Ideal program 
vould have a specially trained mathematics teacher In the 
room full-time to instruct the children with the aid of ihe 
regular teacher. In this situation the mathematics labors* 
tory teacher could do all the scheduling , take care of the 
materials, create activities, and use his special talents 
to help all the children* It also provides an excellent 
opportunity for the development of the other teachers* 

If it is necessary to have a central laboratory without 
a special laboratory teacher, each teacher is then respon* 
slble for the use of the laboratory and its maintenance* 
Often this creates a difficult situation because scheduling 
becomes cumbersome, materials are lost, and the activities 
become rigid and standavdizeU* 

The basic problem with either situation is that the 
teacher can send the class into the laboratory for only a 
few periods a week and at predetermined times, not neces** 
sarily when its service is needed* 

3* Team-room laboratories were created as schools became 
equipped for team teaching* The most diatinguishing 
feature of this type of lab is that it is in constant use 
by the children, and only a small number of them attend 
the laboratory at a time* Usually there is no adult in 
the laboratory because the children are in sight of a 



teaching team member in an adjacent room. Children 
work in the laboratory on mathematics concepts of current 
interest or on any mathematicd topic that the team considers 
useful to the children. The arrangement provides easy move- 
ment in the team situation and allows great flexibility a 
child might spend all day In the laboratory to finish some- 
thing in which he is interested. 

The roving, or movable, laboratory is useful when a scl 
cannot afford to buy many materials and does not have a room 
for a central laboratory. The materials are carefully item- 
ized and placed in containers for easy assembling by t..e 
teachers. The container for a particular topic has all the 
necessary materials for the child to investigate the related 
problems freely. All the objects are then put on a large 
movable cart, and a schedule is created to allow access. 
The teacher who gets the laboratory during a certain period 
of time can quickly lay out the containers and produce an 
instant mathematics laboratory in the room. In this situa- 
tion the teacher must take the entire cart during the mathe* 
matics period and return all the materials afterward. There 
are disadvantages to this type of laboratory: for example, 
access is not immediate when the need arises: the laboratory 
does not grow in increasing variety; maintenance is difficult 
and unless staff development is provided, the activities 
lose their mathematical significance. However, if this is 
the only type of laboratory that is possible in the school, 
it is better than no system at all. 
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riu' purposes of a matiicnatical laboratory muat also bt^ conaiderud since 
they doterralnc tho typo ot* laboratory needed and the characturlstlcs of 
the activities. Children can derive manv benefits from a lab period which 
can be tranrtlated Into objectives and suinmarUed uiider these four major pur- 
poses: 

a. motivation 

b. enrichment 

c. articulation with the res^ular mathematics program 

d. review, reinforcement, and remediation, 

tlenerallv a mathematics laboratory is designed to satisfy the needs of 
all the children and will provide activities consistent with the four pur- 
poses of a laboratory listed above. Even though a school might think of a 
laboratorv as having a special purpose, and as a specific typo of room, the 
laboratory can serve the needs of all the children in the school. While to 
one child an activity is motivating, to another it might be review and rein- 
forcement or even enrichment. Still another child mipht be working with a 
game that Js motivatinj* and suddenly find it has weaning for the concept he 
is presently leamlng lu class. 



THE GENESIS I.^ PHIL.VDKLPHIA 

The movement toward nath laboratories began in the summer of 1967 with 
a concentrated course in tho use of concrete materials given by the Madison 
Project for teachers and administrators. A portion of the program was do- 
voted to observing children at work In a math laboratory setting. Strong 
emphasis was placed on manipulation, discovery, freedom of movement and choice, 
and a large variety of materials and projects. 
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This was mosi; certainly the first time many of the teachers and prin- 
cipals had witnessed this type of environment and excitement was evident 
throughout the weeks of the course. While the teachers saw '*MANNA," some 
administrators saw '^MADNESS/' At the end of th« course, the principals were 
still at j^rips with these questions: 

What is the curriculum for a Math Lab? 

How does it fit in with our present graded Mathematics curriculum? 
Where will the money come from to purchase the needed materials to 

properly stock the Math Lab? 
Who will train the Math Lab teachers? 
Where will I find the room to house the Math Lab? 
How do I get a teacher released full«time to organize* run, and 

in-^service the other members of the staff in the Math Lab? 
How do X get the parents and other teachers excited enough to see the 

significance of the I'lath Lab? 
Uo X want this type of noisy experience that allows freedom of movement 

throuifthout the room ^d the school, when I stress discipline so 

strongly in my school? 
Each principal obviously left the course with a different view of what the 
math lab should be for his school situation » tempered with the reality of the 
above questions. 

If a graph were to be drawn of the number of math laboratories created 
after that initiation, a graph of the intensity of enthusiasm for organising 
activity-centered classrooms, it would look like this: 
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NUMRER OF SCHOOLS WITH MATH UB ORGANIZATIONS 
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This graph clearly shows that the number of labs Is declining rapidly 
since 1970. At the hlfth point, 75 schools out of the 266 in Philadelphia 
were participating in the math lab concept. While there were other schools 
trving pieces of the activity-centered approach, only these 75 schools suc- 
ceeded In organising a program that comprehensively embodied the principles 
recognized as a full activity-centered program. It is also significant thot 
the breakdown of the different types of labs showed a wide variety of .liter- 
natives, each possessing admirable qualities with both staff and parent 
approval. There were 27 schools with separate lab rooms coordinated by a^ 
full** time released teacher « 32 schools with individual class :.»oms organized 
as math lab rooms providing leadership to the other members of the staff* 
9 schools with team- room math labs necessitated by the organizational pat- 
ten* of teani teaching being tried by the new schools and some old converted 
onest 3 centers were set up to act as both demonstration schools on a limited 
basis and teacher centers to help in proselytizing* and 4 schools had 
portable math labs that travelled around the school in a most effective way. 

The next graph will show how the principals' enthusiasm varied fxrom 
the beginning to the present: 
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ENTHUSIASM FOR THE MATH LABS BY ADMINISTRATORS 
(f;ubJeotive analysis by the Madison Math Coordinator) 
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Why is it that the demand for the math labs LiCreased over the years t 
while the actual units decreased sharply? The answer lies In the various 
current urban thrusts In education, and society at large, that produced the 
fervor for labs, facilitated their growth, but unfortunately produced 
debilitating side effects that aborted many of the attempts* Such trends as; 
1* A concentrated effort In early childhood education which accelerated 
the demand In concrete materials for the very young and sought 
alternatives to the traditional methods of teaching* The federal 
government supplied the funds for many experimental programs In 
this area such as Follow-'Through models (one being fashioned after 
the British Infant Schools), Get Set Centers, learning centers, day 
care centers, etc* 
2* The movement toward the national testing program which brought to 
realization how Ineffective our present methods of reaching children 
were and that new methods had to be employed* 
3« Decentralization of the large city school systems to allow more 

freedom for the local principals to produce their own budgets and spend 
their money In consonancy with their philosophy of educating children* 
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Th« tnovePtMU. tow.ird unto!iij?.ir.ton of teachers which clearlv pro- 
viat»a thi>m wirh a «hart> In tl)e decislon-maklnR nollcies of manaco- 
meat . 

Parental dlsRU:?t with the present school system and their Involve- 
ment In fltrlvln)» for somethlni; different • 

The Influence of many national movements in curriculum that con- 
tinually streAflt»d the activity-centered approach to leamlne. The 
accepted works of Hruner and Plaeet vlvtdlv changed the materials 
and Instructional aids belna produced bv the companies, and the 
current research appearing? In the literature noted the effective- 
ness of the Infant Schools, open classrooms, Madison Project, and 
loarnine centers* 

The proliferation of federal funds for alternative means of 
educating the children in deprived areas* 

In Philadelphia, a new responsive administration, responsive to 
ohanec and Innovation* Stress was placed on providing alternative 
means to roach the children* New experimental schools were 
started, such as the Parkwav Project (school without a building) » 
the Intensive Learning Center* the Pennsylvania Advancement School, 
the Rosmuessan Learning Centers, and many others that were so 
closely allied to the math lab concept* 

A more responsive university program geared to the training of 
teachers for urban realities* Included in many of the programs 
were courses devoted to the math lab concept, along with practica 
In organizing and operating them (Temple University has a number of 
such courses In Philadelphia)* 

The daring new designs in school construction facilitate a flexible 



transition from tha traditional to the opan space concept of 
teaching. Most ndw schools have roons for math labs (these are 
self-contained) or lar>^e rotunda typu units iit>si^nated as learning; 
centers. Practically all the interior classrooms provide space 
for small group or large f^roup experiences with ante-rooms set 
.iside for activity centers in math a*ui science. 
Why then* with all those movements clearly snowballing the momentum 
toward oath labs, did the trend reverse itself so abruptly? The answer lies 
in tlie saddeninft realities that eventually cripple many programs prematurely, 
when they reach the sta^e of practical application. 

The six following conditions may explain part of the problem: 
1* Although federal funds increased, the money available for school 
operating funds from state and local governments became insuffi- 
cient. Most urban school systems had to cut hack on services 
requiring larger pupil-teacher ratios and less supportive services. 
With these severe cuts, the continuation of any innovative program 
becomes suspect. The boards of education in their zeal to balance 
the budget, cut past the marrow and reflected kindly on the basic 
skill programs rather than any project termed "experimental." 

2. The high turnover of teachers in the urban areas meant constant in- 
service training Just to maintain the present level of competence, 
let alone improve it! There is just not enough money available 

to provide the type of continuous, concentrated in-service needed 
in an activity-centered approach* 

3. A communication gap appeared between the parents and their schools. 
Anv program not specifically geared to training children in memori- 
sation of the basic number facts became a frill and was not warmly 
received by some members of the community. 
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4* Discipline probleifts had become ho numerous In the past several 
years' that a full swinR toward the more nradltlonai, formal, 
isolated learning experiences became oxpinllont, 

5. A long awaited, concentrated effort co improve readlnn occurred, 
but unfortunately at the cost of providing funds and services for 
the subject are.is- Any program not clearly stamped "Reading** got 
a lower priority. 

6. And the most dangerous condition of all that usually occurs with 
innovative attempts to Improve learnlne, the bandwagon syndrome. 
Some principals, realizing that the current thrust is toward 
active learning classrooms, proceeded to initiate programs without 
the slow methodical research and communication necessary to gain 
acceptance and success with this type* of radical change. 

Although some of the above points mav seem Incongruous with the present 
trends mentioned before, remember that this often happens when drawing 
board thoughts meet tiie day to day existing conditions. 



THK MIiTA*MORPHOSIS 

Wlien administrators and teachers face a formidable barrier such as 
previously described, what happens? Some creatively find alternative routes 
around the obstacle » some set their sights higher and hurdle It, others 
barrel through and suffer setbacks, the less creative souls lower their 
sights and burrow under, while some relent -turn around— and retreat. 
Certainly It would be beneficial to examine what adjustments and solutions 
were tried during the last four years. 

Case H A middle-sized elementary school, housing grades K-o, 
realized a serious problem In Its mathematics Instruction. Acc< rdlng to 
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the(r s.N^n»s from the Iowa Test of Haste Skills for November of 1969, the 
TMiorlrv nf ^tu«I<»nrs wf»re two voars to two-aiiil-A-lialf v^^ars behind In their 
level of -.n.iti'.t'ipat U:s cnmnt»tunc.e» Tht» teachers, narents, and principal de- 
cideit to srart a central mathematics laboratory to help solve the problem, 
prin^arilv vioslcncfd for remediation, manned bv a full-time laboratory teacher 
who would jlso provtde an Intensified traininR program in '^Modern Math" for 
the stflff. Since thU school was due for a new replacement building in 
Svpt(?mh4*r of the principal included in the building plana the con- 

structti^n of a larpe room (1600 sq. ft,) as a mathematics lab. Materials 
and onut r>'nt»nc ver»* also ordered for over $ll,000,(iO, including a small 
conpiiter. Fortunately, a new school receives an extremely liberal allowance 
for caulpment and supplieB durinc* its Initial yeart However* after the 
flrfit vrar, -none*/ is equalized with the other elementary schools in the 
citv« whlrh ntakes malatainint« exlstina experimental pro^^rams difficult* 
In spite ot that fact, the laborator\' was built. The laboratory teacher, 
of Course, was not included in the staff budget, since money is not liberal-- 
ized for manpower as it is for materials. The principal talked the faculty 
Into spllttln(» up one class among the other teachers in order to release 
someone full- time to man the laboratory. The released teacher agreed to 
take special courses during the summer in the Madison Protect and in the 
I.earninc Centers Project to prepare himself properly. With all good inten- 
tions, t^o laboratory opened alone with the new school in September of 1970. 
There were thirty classroom units in the school and each teacher demanded 
equal time In the laboratory. The laboratory teacher wanted to focus on 
the lower (trades and only work with those children whose scores on the Iowa 
were below the 16-percentile (the non- function ins educational level) and give 
th#»m concentrated sessions throughout the week* The teachers demanded 
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that complete classes work in the lab since they felt that all chiiait-a 
wcuJd benefit from the laboratory, Tliey also telt since tUey had iiicrtiasfd 
tncir class aize voluntarily, the sessions shouUi ;)e consulered t r^f tune tor 
the clcissrrjom teachers. Witli these restrictions, naturallv ciie Jauoratorv 
was doomed! Ihe principal at^reed to all the conditions because la telt so 
stront^lv that tiie laboratory was needed and he knew the lab teaci er nad 
prep.ired hlm.'.uU well tor the chore. 

In order for each of the thirty teachers to ^et a laborator period, 
the lab t<»acher had to f^lve up his lunch periods «ul any preparation time 
needed between the classes. Certainly, no time was left for in-j.orvlce 
training .ind since the teachers refused to remain in the laboraturv durtnx', 
the sessions, no articulation took place in the cla^sroo^lS. No rsatter how 
hard the lab teacher worked durluR eacii tliirty-five minute lab i erlod per 
week, ntme of the classes truly benefited, llow much individuaiicatlon can 
He done with over 050 students and one lab teacher shackled wltiiojt time for 
Dre::arat Ion? 

liie Iowa scores for the following year remained the same and in some 
cases decreased. Bv the end of the year, the lioard of Ivducatiou cut its 
budget, laid off teachers, reduced supportive services to the schools, and 
increased class size. The teachers at the school felt the lab reallv did 
not accomplish its ^oals, and discipline problems had increased alaminf,ly 
because of thf» large classes » so the lab was closed and the teacher went 
back to the classroom as part of a three-man team teaching unit (his respon- 
sibility — Language Arts!). 

Mthough this Is the story of one school, it reflects the conditions 
existing in other schools. No matter how hard the princlnal tried to get 
support for the program, he was thwarted in his every attempt. The laboratory 




remained i^mpty, the naterials crated up and innc^eslbltj, md teachers 
did not move away r rom the tradltlon.il lecture-textbook method of 
aedi»'i*rtty. 

^' — A larj»e, ovt»r-cri>wt^O(^ , "vintage" Itmlor hit^h school took a 
fiurvev and found that thi» .ivprat't* ninth r,rade student In their school had a 
fifth •?r.ide reading: level and a heistnnln^ sixth crade level of competence 
In natiienati :s» Hiaed on th*<i survev, a creative, resourceful math teacher 
vrotij a proposal ^or a fi»dt»ral i*raut to set up a irotlvational tvpe Mathe- 
"latlcs Lahoritorv for remerUal el'»hth f;rade students, deslj>ned to rekindle 
ail Intoresr in matht?nat lcs» Hie. proposal was funde»i fov three vears and 
consistf*d of a sal.irled position for ovfranlzintr and operatlnf^ the laboratorv, 
plus ^i,S'M> for f-^atoriilfi and otiulpment* The prlnctnal found an unused 
«?tockroo*n to housG the opf^r.itton .tnd cho laboratory opened In September, 1968* 
Ml tiie ro'^fidlal nathon-^tlcs clashes in eighth Rrade were scheduled into the 
laboratory for two of their mathematics periods a week, with open slots for 
independent studv. The honeroom teachers had the option of attending the 
sessions: it was not made niandatory! At first the laboratory was suspect* 
Mont of the students felt it was childlsn, a playroom, demeaning their level 
of sophistication, comparable to the "Dick and Jane" readers they were forced 
to enjoy in their condescending*, remedial readlnt; classes. The lab teacher 
had stocked the room wit'' v\aint.*s , calculators, computers, Culsenalre rods, 
neohoards, (Tooh locks, pattern blocks, attribute ^ames, mirrors, tanf>rams, 
etc. After a few ;ionths of recalcitrance, the laboratory teacher realised 
that he Jijd to remold the i!ia<»e of the activities and make them relevant to 
Oichth ftraiie students. He invited "star'' academic classes to the laboratory 
a few periods a week as an enrichment center and taught new subjects pre- 
viously reserved for hivM school, using the same materials! When the 
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remedlal classes came Into the laboratojrv, they also wanted to he oatt of 
the enrichment proeram. New topics were tried, such as: transformations, 
svmnietry, tessellations. Boolean Algehra, calculus, comput<»r prop,ramnilnji» 
etc. The approach worked! The students flocked to the laboratory with 
enthusiasm, not even reailzlnR they were working with the same materials. 
They were learning new areas, but also cement InR the primary concepts that 
had before caused such rebellion. They tackled new and interestlnR topics, 
without nausea, because they had not previously developed that pernicious 
failure syndrome so closely allied with repeated learnings. 

By the eighth month, almost all the homeroom teachers stayed durlnc( 
the laboratory periods and assiduously helped the students with their 
projects. Sometimes the atmosphere electrified the teachers more than the 
students and the laboratory teacher found It harder to remove the homeroom 
instructors! Kventually, the Ideas found their way Into the regular classes 
and a svstem of borrowlna materials during the off laboratory periods 
developed naturally. 

A follow-up study the next year showed a substantial Increase In both 
mathematics and reading scores for over 65% of the laboratory students. In 
the September 1969-70 term, success became even more pronounced as the 
seventh srade remedial classes were added. The teacher was sedulous enouj^h 
even to visit the "feeder" elementary schools and observe the Instructional 
program the students were experiencing in the sixth grade, so he could 
provide a facile articulation. He even ran In-servlce sessions for the 
elementarv school teachers so thev could better prepare their students for 
secondarv schools. 

Unfortunately, as Is usuallv the case In junior hlch schools, the 
laboratory teacher transferred out of the school. Knowing he was leaving. 
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he trained someone else a.^ a replacement tot the iaboracoryt but the 
enthusiasim rogresaed. The new teacher returned to the remedial activities, 
vlth which he felt more confident, and rapidly evoked a violent vlsc«;ral 
reaction amon;; the students* As conditions In tne scnool became more over- 
crowded, and the cut In services occurred once again, the laoorar.ory teacher 
feared for his tenure. The laboratory closed* The remaining yeat of the 
proposal was forfeited because^ It became Impossible to tultill Its pro*- 
visions, and once again the children returned to the soporific, lecture- 
textbook method* 

Continuity In Junior high school p-athematlcs Is an encroachlnt; problem* 
The highest turnover rate among teachers (3U%) occurs at this level, and so 
do the most serious discipline cases, which Is concomitanc with the self- 
reallzatlon and self-seeking stages of development that all teenagers 
experience* 

Case //3 Let's now look at a new middle school that was built and 
organized for team teaching* A cluster of three open-spaced rooms, an 
enclosed planning room, and another small anteroom, comprised each cloistered 
team model* The principal and the teachers wanted a non-*graded organization 
(Df course, they really never had the planning time before the scnool opened 
to develop a smooth transitional change from the self-contained to the team 
situation) based on vertical teaming within the subject areas* Three men 
teachers voluntered to teach all the mathematics to one hundred students at 
a time. In forty-five minute class periods with mixed age groups from grades 
five through eight. In some cases, double periods were scheduled. 

ihe small anteroom was generously stocked and labeled Mathematics 
Laboratory and the students were allowed complete access to the room for 
varying lengths of time* The teachers worked well together and spent all 
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thelr free time at lunch each day planning the various activities. 

Two laterustlng problems occurred. TIk* non-graded organization, which 
actually was the principal's preference, was too difficult for the team to 
handle (especially since It was a new experience for them). No natter how 
they f»rouped the children. It eventually fell upon grade lines since fifth 
graders and eighth graders had too wide an experiential background to work 
together on similar concepts. Tlie peer group relationships also produced 
a tense situation. The team felt It could do a better Job of Individualiza- 
tion by operating within grade lines and taking one grade level at a time 
during the raathemaclcs periods because the social adjustments played havoc 
with the lessons throughout the day. However, the principal remained 
ada:aant in Cwntlnulng the present organization. 

Secondly, the diminutive effects of the team teaching situation must 
also be considered. Because of the professionalism, experience, and dedica- 
tion of the three teachers, the five ubiquitous problems that eventually 
decimate most team teaching experiments seemed to be abated. The problem 
of a lack of team planning time was solved by having dally "lunch-ins** 
(although an unfair method). The unfortunate situation of "turn- teaching" 
that usually develops In the vacillating Interrelationships of adults when 
one member decides to lessen his load and take ''small breaks" was resolved 
by the exemplary manner In which all the members pulled their share. The 
difficult problem created by a lack of paraprofesslonals which so severely 
limit the araount of Individual or small group Instruction that Is concomitant 
with team teaching was alleviated by building a favorable attitude of peer 
assistance between the upper grades and the Im/er grades. The teacher absence 
problem that literally destroys a team never became an Issue because the 
teachers were extremely responsible In that respect. Ustly, the problem 
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of a lack of materials and activities that propagate individual instruc** 
tion resolved itself by drawing upon the fertile store of knowledge of 
the experienced teachers and the strong support of the principal who gave 
them more than their fair share of tlie school's budget. It was truly a 
successful program, but a most difficult one to administer. The unfair 
load shared by the teachers was soon to become a bane, thus ending; this 
happy troika. The second year of the program one of the team members left 
for a promotional Job* which necessitated training a new teacher to fill 
the abyss. Another member soon left in the middle of the third year and 
that was the final coupi The remaining teacher, already overburdened with 
providing in-s<>rvice sessions for the two new members* sealed off his 
middle room and taught a self-contained classroom for the rest of the 
year. The mathematics laboratory became a stock room and the unique pro- 
gram a forgotten dream. 

One painful lesson educators can learn from this case is that the 
master teachers (especially men) look toward promotions after a certain 
degree cf tenure is realized. It always strikes me as odd that we reward 
the good teachers by removing them from tlie classrooms. Uliy not p/ovide 
merit scale pay to keep them where they are most effective? Certainly 
the "Peter Principle" pervades the school system; time aad tine again, 
whenever you find a good team of teachers operating a program, the odds 
are that they will not be together very long. 

Case tiU — By now it seems tiiat all the mathematics laboratory 
situations have become aborted after a meteoric attempt at success. Let's 
now examine a successful laboratory in an elementary school, located in an 
inner-city area. Tlie principal, impressed by the pervasive excitement and 
apparent success oi a laboratory he visited in a neighboring school. 
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dedicated himself to organUlng a slrallar program in his bulldlnfi. He 
refilUcd It would be a difficult task, because he had a 35?; turnover of 
staff each year, with an average teacher tenure of 2^/^ years. Thu 
principal in his wisdom, however, decided he could carefully avoid thci 
pitfalls ahead if he planned for themi He knew Ingenious solutions had 
to be found for the six persistent problems associated with previously 
existing laboratories that he had seen end prematurely; 

X. Finding perennial funds outside the realm of the school 
system that would Insure program continuity. 

2. Finding a teacher willing to assume the arduous task and 
insure her continual tenure* 

3. Finding the planning time necessary for the laboratory teacher 
to prepare materially, emotionally, and mentally for the 
position* 

4. Gaining the acceptance of the staff and parents to expand 
the program, therefore assuring its existence beyond the 
present team of teachers. 

5t Finding the room to house the laboratory in an already 

overcrowded school* 
6* Reorganising the school. If necessary, to free the laboratory 
teacher full-time and be reasonably certain that future cuts 
would not endanger her position* 
For one full year, the principal carefully planned his moves with 
administrative acwen. He decided that a nearbv unlversltv would be Ideal 
for stability, and arranged to have a student teacher center for the 
training of undergraduates In mathematics laboratory techniques Initiated 
in his school* The undergraduates provided four cogent services for his 
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p rolipram: 

1. The student teachers could pro* *de released time for the laboratory 
teacher to be used for planninK or Intra-denumst rating. 

2, They could act as paraprofessionals , lowering the pupil-adult 
ratio and aiding in individualizing activities* 

3* Since it has been established that almost 75^. of undergraduates 
request appointments in the school that thev did their student 
teaching in, the program would then actually he a pre-servlce 
training for future staff members, thereby insurintj the active 
learning projjram*s continuance. 
4* With sp«acial arranp,ements, the principal was able to secure a 

substantial sum of money for the laboratory teacher in considera- 
tion for the tine she would be spending In-servlclnp, the under- 
p.raduates. The university v;as nulte pleased with this on-the-job 
trainine plan and this added Incentivp cemented the lab teacher's 
positive feelings toward her new rol(>* 
Several professors from the university offered on-site staff development 
programs for the school before the program began* The principal watched with 
apprehension, hoping to find one member on his staff willing to assume the 
new role. With certain alacrity, one teacher became extremely excited with 
the activities and volunteered her services as the laboratory teacher. This 
teacher formed a team with three otliers in the same grade, each one agreeing 
to cycle their classes into her room for mathematics, while they divided up 
the remaining areas of the curriculum* This meant that all morning the 
laboratory teacher had four different classes rotating into her room for all 
their mathematics instruction* The principal « an adroit scaveneer» found all 
the unused mathematics materials in the school (and there were plenty) and 
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syphoned thm into tl^c laboratory. The teacher was Riven one full year of 
cracti liofnre beclnnini^ the pro«ra«i| durlns; which time she would be expert- 
n:iairiuR ana Umrntng from many of the consuLtantfl available from the central 
iRathemarlcfl office. Her in-service training was carefully planned by the 
principal co Insure a well-rounded program, 'rh« laboratory teacher took courses 
at thtt unlv.ersli.v, offered by a professor who worked with Dlenes. which 
exposed her to one model for active learning. In July, she spent two weeks 
at Syracuse University working with Dr. Robert Davis and the Madison Project; 
the remaining two weeks of July were spent in an Infant school project In 
Philadelphia, operated by Sybil Marshall for the Committee on Independent 
Schools, In August, two weeks were spent In New York working In The Schools 
for the Future Instilling Gategno's philosophical beliefs. In the last two 
weeks of August, she visited the learning centers already operating, enabling 
her to spend many hours discussing with the successful laboratory teachers 
in the city. 

Assured and anxious when the new term began, the program was launched 
with anticipatory glee. 

Every Tuesday the laboratory teacher was required to give In-servlce 
sessions for the student teachers after school. The school staff was also 
Invited and the adult community surrounding the school. In the hopes of 
proselytizing. Eventually, the volunteer trainees totaled twenty-six by 
the fifth month of the term. Three other teachers were so Impressed with 
the effectiveness of the laboratory program that they "bargained" with the 
principal to allow them to organize similar cycles In their grades. The 
principal readily agreed, only If they were willing to devote the required 
time that the laboratory teacher did In pre-servlce training. They consented 
and by the beginning of the next year, the school had four operating cycles 
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In grades 3, 4« 3, and 6* This meant chat dixteen classes were now receiving 
all their mathemacics instruction from well*trained» enthusiastic teachers* 
When the ax finally fell, tolling severe cuts in services and manpower, the 
program remained unaffected* The principal had done hij job well; the funding, 
extra personnel t and lab teachers were sacrosanct because they were clothed 
from extra-territorial sources* 

Case A high school on the fringes of a well integrated neighbor- 

hood was faced with an unusual situation; their main building was so over- 
crowded that the placement of any new students defied solution* The school 
district decided to decentralize the program and experiment with the "House*' 
concept by placing all the tenth grade students in one annex, several miles 
away, for a cloistered learning experience* The usual passive tenth graders 
presented a unique, pleasurable challenge, and the teachers assigned to the 
annex decided to capitalize on it* They were given an opportunity for wide 
leverage in their planning because of the newness of the program and the 
small size of the student body. The school district also felt that a number 
of innovative programs could be tried by the staff without complete chaos 
because of the diminutive discipline problems presented by the freshmen 
classes. The Mathematics Department chose their own chairman, separate 
from the main building chairman, and decided to center their program around 
a mathematics laboratory* 

The building was an abandoned warehouse that the school district rented 
and planned to renovate to relieve the overcrowding* As a precursor for 
future policy* che districn allowed the teachers to be in on the initial 
phase of the building construction* Their suggestions were not only listened 
to^'-'but followed! 

X\ie mathematics department designed their own classrooms and the central 
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laboratory; and coordinated with the roster chairman to schedule each class 
Into the laboratory for two of their flva mathematics periods a week. The 
laboratory that wasJ envisaged by the mathematics teachers was significantly 
different than others previously tried In our city. Two cogent reasons 
accounted for this dissimilarity. First » hl^h school teachers are specifi- 
cally trained In their disciplines, which Is not usually the case in ele- 
mentary, middle, or junior high schools. This factor leads to a more sophis- 
ticated, academic type laboratory, with activities carefully selected and 
scquencsd to reach specific goals. Teachers lower on the hierarchical grade 
scale do not possess this slngle-dlsclpllned background; their laboratories 
tend to be less Integrated and provide fewer alternatives for the children. 
A mathematlciau can always tlnd several routes to travel in reaching his 
goal, while **gene rails to* have to search assldunusly Just to find one alter- 
native approach. The second difference Is related to the length and depth 
of In-servlce training needed by the laboratory teachers. Certainly with 
the Intense course requirements mathematics teachers need for certification, 
it would require only a few short lessons in the active learning approach for 
their edification and stimulation. They are quite quick to grasp the mathe- 
matical significance of concrete activities and can readily extrapolate 
numerous Innovative ideas from just one suggested lesson. 

The responsibility for the operation of the laboratory was cheerfully 
accepted by the new department head, who Is usually only rostered for two 
periods a day: the remaining time reserved for administrative details. Instead, 
tie department was so small that they felt the non-teaching duties were 
minimal, so It was natural for the chairman to assume the leadership for 
the laboratory. The chairman, along with the department, decided that the 
center should be an "Articulation** laboratory, utilizing concrete materials 
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and active learning projects based on the same concepts that the classroom 
teachers were simultaneously teaching* In this way the students would be 
^•ettln<; both CUe concrete applications of mathematical ideas and their theory 
in abstract fotmt 

All the components for a successful program were there: 

1. The money for materials and supplies was generally requisitionedt 

2. Tile team of mathematics teachers was highly competent in their 
respective areas. 

3. No new personnel were needed to operate the program. 

4. riu-Te was clear evidence of coordination between the laboratory 
at\d the classroom lessons* 

5. The laboratory teacher was the mathematics department head, and 
was highly respected by the staff and provided the key leadership 
in curriculumt 

6. Cooperative team planning preceeded the laboratory's initiation, 
which insured motivational impetus (the halo syndrome) # 

Obviously » the program did work and is still working in the high school 
annex. Other schools (even Junior high and middle schools) have sinco 
adopted the house plan with the central core of activity being the learning 
center. Some adaptations liad to be made for the lower grade teachers 
because of the nature of the learner and the nature of the curriculum. The 
learning centers arc usually not concentrated in the mathematics area alone « 
Instead they are integrated activity centers with all the areas of the curri* 
culani given an equal status. This movement, necessitated by the new school 
constructions of gargantuan proportions » is a reflection of the ambiguity 
of pedagogy. The teachers are seeking controlled situations that allow free- 
dom for individualization and identification of learning problems, while the 
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archttects are promoting mausoleums cf mass education, which change the 
noticed to the nameless* 

Parenthetically » there are reversing trends that hooefully will have a 
salutary effect on the thinking ot* the designers of tomorrow. Two Interest- 
ing developments In Philadelphia are manifestations of these Innovative move- 
ments. The Parkway Program, which Is called the '^school without walls/' 
resides along a tree-lined avenue densely populated with cultural, esthetic. 
Industrial, ana administrative organizations vital to our city's operation. 
The students from grades nine to twelve (however, the school Is non-graded) 
are rostered to these multiple sites according to their interests. They 
choose the curriculum and avail themselves of the expertise abounding In 
the Parkway area. Participants In the program Include the Franklin Institute 
and all its Acientiflc resources « many Insurance companies with their com- 
puterized actuary deparu.fints, the central office for police administration, 
a television studio, five different museums (including our world-famous 
art museum), the main public librarv of Philadelphia, the Philadelphia 
school administration building with its curriculum experts and reference 
library, along with many other buildings and Individuals who volunteer their 
services to the children. The students are continually mobile and content, 
studying relevant concepts offered bv field experts. Tlie cost of the opera- 
tion Is lower than the average per pupil cost experienced by the school 
district, the savings being realized from the absent cost of a central 
building and the use of outside, volunteer teachers. Presently, another unit 
is operating as a middle school In a different part of the city and plans 
are being formulated for starting an elementary school age model. 

The ••scattered" middle school concept Is another fascinating innovation 
In the constant search for providing mlnl-self-contalned schools within 
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tehemoCh oiv^ani^ations* Developed by one of our school districts, It plans 
for sntall fanlly type units scattered throughout the community* Although 
collectively the student population will he large, it will be so geographl** 
cally spaced as to allow the individualising of learning styles which is only 
present when teachers truly know Che learners. 

I'hese three approaches, the Parkway Program, the Scattered Middle 
School and the House Plan, transcend the abyss and provide a sanguine sign 
for future planners. 

THK PAPxALYSIS 

At one time our Director of Mathematics developed a program of con- 
centrated in-service training, specifically designed to produce two key 
teachers in each elementary school as grass-roots leaders in mathematics* 
Realizltiv: the job of training every teacher would be too costly and 
overwhclning, it seemed pedagogically sound to Just locate two leaders in 
each school — one from the primary and one from the intermediate grades— 
and saturate them with the current trends and activities useful for the 
elementary <>rades* The supposition being they would be the storehouse and 
transmitter to the staff in the area of mathematics, eventually elevating 
their status to a respected leadership position in their schools. It would 
then be quite easy to efface changes in curriculum and management dealing 
with only a small number of consistently motivated professionals* 

Clearly the area of reading is far ahead in this respect* Each 
elementary school in Philadelphia has a lead reading teacher released full- 
time to provide the necessary leadersliip in staff development' but mathematics 
has never enjoyed this salutary position* Being second-best, we have to try 
harder ! 
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Urtfortunately. the plan formulated by the Director of Mathematics 
never materialized. No matter how assiduously we trained the submitted 
candidates, we found the program vaa self-stultifying for five reasons; 

1. The key teachers were usually selected for other criteria 
than their competence in mathematics or their ability tc 
command the respect of the staff. The principal forcibly 
chose the key teachers from seniority status or even more 
regrettably, '^closeness.'* 

2. The turnover of the teachers was too devastating to enable 

the nathewatics department to provide any continuity of service 

the schools. Each succeeding workshop produced more and 
mri-e new faces » until the gaps between the tenured and novice 
became too wide to handle effectively. 

3. The principals could not adequately accommodate the released- 
time, staff development sessions that the key teachers 
required, with only in-house coverage. Without any outside 
assistance for substitutes' pay or stipends foir after school 
training, it was untenable to believe any consistent service 
could be provided. 

4. The elementary school teachers* background and perception of 
mathematics education were so traditionally oriented that the 
applicability gap between present practice and modern theory 
seemed unbridgeable. This compounded the insecurity of the 
key teachers In their leadership roles since they soon realized 
their Inadequacies were causing withdrawal symptoms. Inhibiting 
them from assatilng their responsibility for directing others. 
They had so many adjustments to make themselves, that to mold 
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otUcrs was incomprehensible. ^ 
5. The assumed extra burden of leaderHhip carried with it no 

compensatory time or compensation for the key teachers who 

still had the ubiquitous task of full-time classroom teaching. 

Obviously, little transmitting could be done. 
Failing that scheme to build in local expertise that would eventually 
promote the mathematics laboratory concept in the schools* another opera- 
tional plan was proposed. It entailed utilizing; the district-wide mathe- 
matics collaborators (each of the eight districts had one resource person 
in mathematics instruction for an average of twenty-five elementary 
schools) in producinc; up-to-date, easy-to-follow mathematics guides and 
activity booklets that would sensibly lead the teachers into mathematics 
laboratory experiences. Many arduous hours of dedication were spent in molding 
a comprehensive elementary mathematics program that was truly a vanguard in 
education. Even the most uninitiated could successfully provide a healthy 
learning environment for his children by following the suggested program. 
The proliferation of materials included: 

1. A new intermediate guide (affectionately called tie "Jolly Green 
Giant'* because of its enormity) which grouped the mathematics 
concepts into 18 levels, enabling the teachers to transgress 
sensibly into the realm of non-gradeness. The guide included 
not only the sequential concepts, but background and methodology. 

2. Levels tests and summary forms that pinpointed the weaknesses 
and strength** of the students. The tests were specifically 
designed to be used with the guide. 

3. Activity booklets for each level demonstrating the use of concrete 
and semi->ahstract materials in concept formation. 
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4. Teacher Resource Centura in each district, opened after Hchuol 

and during school hours when needed, as an immediate source of 

help In giving teachers advice, warkvshop Instruction, malerials, 

f 

and space to construct instructional aids. 

5. A large quantity and variety of task cards that teachers could 
request from the central mathematics department In sufficient 
numbers to help them get started in their laboratory. 

6. A series of creative workshops for interested teachers based on 
current topics of need. This was done to continue the stimula- 
tion previously given the key teachers. 

Secure in the feeling that the bacU-up materials and supportive services 
were sufficient to create the transition from the insecure traditionalists 
to motivated mathematicians, all watched with anticipated success. But, 
plaintively, we once more experienced the inevitability of frustration; 
well-written guides and booklets — no matter how "teacher-proof* — still 
presented serious debilities. (You can lead a horse to water—but you can't 
make him drink.) The educational moral being, "Indirect stimulation through 
the written word is a far ^:ry from getting ideas put into action." 

Simultaneously, another approach was tried which involved the initia- 
tion of the Madison Mathematics Program in 1067. Tlie program supplied a 
coordinator for the city and a generous budget to begin the project. The 
Madison coordinator was well advised by the Mathematics Director, collabora- 
tors, and supervisors as to where the best prospects existed for implementing 
his pro'»ram. This time the candidates to !;e trained were chosen bv outsidP 
experts who knew, objectively, the abilities and motivation of the teachers 
in the city. During the following three years, the coordinator slowly and 
meticulously trained laboratory teachers and helped organize activity centers 
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In many achoolH. With his own 8updrat« budget auU auu^af filiation with the 
adminlsCraCion of the schools, he was able to work independently and avoid 
the usual ced tape problems associated with large bureaucracies* 

T\\e Madison mathematics program was pervasive* Working only with the 
most promising teachers, a strong following developed that soon built a 
dynasty of mathematics laboratories across the city. Eventually, the 
momentum declined in 1970, related to the reasons outlined previously in 
tie first section of this paper* 

Ke.^rettably » an unusual situation existed in our mathematics program* 
Thf three*pronged attack at improving the teaching of mathematics, including 
the key teacher program* teacher-proof materials, and the Madison Math' 
Project > failed to build that elusive bridge between antiquated practice 
and cuvrently accepted practice* 

The most recent strategy being tried by the Division of Mathematics 
is to apply various pressures on the undergraduate institutions to update 
their current teacher- training programs and provide practical experiences 
in Che mathematics laboratory techniques* Temple University (which supplies 
over half of our new teachers) accepted the challenge willingly and created 
many innovative programs in their Math Education Department. The new courses 
provide the prospective teachers with active materials-oriented curriculum, 
alon^, witli practica of various lengths (some as soon as the sophomore term) 
as <)tudenc teacher laboratory assistants to successful mathematics laboratory 
teachers in the elementary schools. It appeared logical that providing 
students with the properly accepted techniques of teaching math to children 
and {'giving then the necessary background to put those ideas into action, 
would eventually prove fruitful* This could alleviate the sterile machina- 
tions that quickly overtake some teachers lacer on as they face the everyday 
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crials In the classrooms* 

But once more the paralysis occurred* The Board of Education had to 
cut funds to survive, which meant that the hiring of any new teachern for 
the year 1971-72 was at a standstill* The freshly graduated seniors had 
no place to go — the system was closed I 

This then Is the urban dilemma. The mathematics laboratories are 
declining, for obvious reasons, and no matter what means are applied to 
stabilise or reverse the trend, paralysis soon sets Inl 
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A R£VXKW OF RESEARCH REGARDING 
MATHEMATICS LABORATORIES 

This paper is written in three parts* Part one presents a description 
of what a mathematics laboratory might or might not be. Part two contains a 
review of research dealing with oath labs and activity learning. Part three 
presents a summary and a charge* 

I 

Over the past ten years, "mathematics laboratory" has become an "in" 
term in mathematics education. In the world of the classroom, it means many 
things to many teachers. In the world of research, the findings regarding 
math labs are mixed. The current research concerning math labs is clouded 
in the same way that discovery«learning research is clouded; namely i the 
definition of the term presents a problem. 

While many interpretations try to coexist, there appear to be two 
different basic interpretations of what constitutes a mathematics laboratory. 
One interpretation focuses on the physical nature of the classrpom and the 
presence of hardware. There is a place which is referred to as the mathe- 
matics laboratory. A second interpretation focuses on the mathematics labora- 
tory as a teaching strategy— a way of reshaping the role of the student and the 
teacher in the classroom. In the Judgment of this writer, a mathematics 
laboratory should be a synthesis of the physical interpretation and the teaching- 
learning interpretation. In a mathematics laboratory, students process infor- 
mation. Students use concrete, physical materials to help them arrive at 
generalizations or solutions. They are working individually, in small groups, 
or as a class. The teacher's role is consultative-*not answer giving or 
expository. 
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Kleren (1971) refers to a macro-lnBtructlonal versus a snlcro«*ln8truc** 
tlonal role for activity learning. I would like to apply this dichotomy to 
the mathematics laboratory. The macro-Instructional use of mathematics 
laboratory will be Interpreted to be applicable over the several content 
objectives at a given grade level* The mlcro-lnscructlonal use of mathemaulcs 
laboratory applies when teaching a single Idea or concept. Although It might 
be argued that a macro- Ins true tlonal use of math labs necessarily Implies 
that there Is a facility and lots of hardware, the atmosphere of the classroom 
Is what makes It a mathematics laboratory-- be It micro or macro* The micro- 
Instructional use of math labs fits with the teaching-learning strategy 
Interpretation* 

It seems fairly obvious to this writer that there are Ideas In mathe- 
matics programs at any grade level which lend themselves well to Interpretations 
In the physical world. It also seems reasonable to me that some abstract 
Ideas should be treated as Just that* The decision to use math labs In a 
classroom should be made on the basis of the dally content objective* 

If math labs are thought of as a t>Iace » then the physical world and 
the mathematical world must be compatible before any great success will be 
realised. If math labs are thought of as a teaching strategy, then any 
situation where It Is expected that students will process Information and make 
Judgments could be Incorporated Into the laboratory. The atmosphere of the 
classroom Is of primary Importance— not nhe hardware. It Is what you do with 
the materials rather than the fact that they exist. 
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II 



The research reported in this paper will consist entirely of citations 
that were not given in the October. 1969 Review of Educational Research . 
Kieren (1969) or the December, 1971 Arithmetic Teacher . Vance and Kieren (1971). 

First, consider some older research dealing with manipulative materials. 
Sorae of the early research dealing with manipulative materials attempted to 
get at the effectiveness of specific materials. For example, the research 
dealing with rods had mixed results. Hollis (1965) and Lucow (1964) 
reported more learning when rods were used. Haynes (1964) reported no signifi- 
cant difference, while Passy (1963) found that the use of rods caused 
significantly lower scores in computational skill and reasoning. 

In the older research, it is rather common to find studies which dealt 
with learning aids. If these studies were done in the »70»8, they would likely 
be math lab studies. Sole (1957) reported a study using manipulative materials 
to teach arithmetic. He concluded that the effectiveness of the learning of 
arithmetic depended more on the teacher than the materials used. He warned 
that educators must be careful not to confuse the manipulation of materials 
with the learning of arithmetic. Sole further stated that arithmetic is a set 
of ideis and not a system of concrete materials. Eidson (1956) made a similar 
observation in citing that instructional aids themselves seldom teach arith- 
metic. The role of the teacher in their use is paramount. Swick (1959) 
cited data which gave strong support to the desirability of using multisensory 
aids in teaching arithmetic computation and reasoning. He did not find any 
unusual interaction between ability of pupils and the use of multisensory 
aids. He did note an improvement in the attitude toward arithmetic in those 
second- and third-grade pupils in the experimental sections. Ebeid (1964) 
reported on a study at the junior high level whereby students were allowed to 
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self **8elect activity-oriented materials* He found no significant difference 
between experimental and control groups on achievement or attitudes* Cohen 
(1959) In a study dealing with solid geometry in the- twelfth grade concluded 
that there is no Justification for the claim that construction of models by 
students during the study of solid geometry will further growth in ability 
to visualise* It is the judgment of this writer that the inclusion of some 
examples of research prior to 1965 may well help to set a stage for the more 
recent research which will be reported in the remainder of this paper* 

This next section deals with research which I have classified as being 
macro-instructional in nature* This means that the miiLl*>afflatics laboratory 
was used to teach several different content objectives and for a period of 
twenty or more consecutive school days. Wynroth (1970) reported a study 
involving the use of game activities in kindergarten and first grade* On the 
basis of achievement tests, the results were significantly higher in favor of 
the experimental groups* Game type activities , whether they be pencil and 
paper or involve some manipulative materials » are often classified as being 
part of a mathematics laboratory* On that basis» I have included this study* 

Weber (1969) in a study using first**grade subjects examined the relative 
effectiveness of two treatment groups whereby treatment group one consisted of 
reinforcement of mathematical concepts through the use of paper and pencil 
follow-up activities, and treatment two consisted of reinforcement of mathe*- 
matical concepts by the use of manipulative and concrete materials. The study 
was conducted for thirty consecutive school days, and the results indicate 
that there was no significant difference between methods as measured by the 
instrument used, although a definite trend favored manipulative materials. 
Children from the manipulative materials group scored significantly higher 
on the understanding instrument. The statistical design provided for an 
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examination of interaction effects, and while the interaction effect was not 
significant, the trend favored manipulative materials with low socio-economic 
status children. 

Howard (1969) reported on a study involving culturally deprived academi- 
cally retarded rural children in a mathematics laboratory setting. There were 
only twelve subjects in this study. On the basis of her findings, one conclu- 
sion that she mentioned deals with the older child who has missed the experi- 
ences of sorting* counting, classifying, and partitioning sets. Howard feels 
that this child needs experience with concrete objects. She also made the 
observation chat the laboratory setting can accelerate the usually retarded 
communication development of the culturally deprived and academically 
retarded child. 

Dienes (1971) reported on a project which includes 60 experimental 
elementary classes. The project is investigating the nature of complex 
learning in mathematics. Two additional goals are to: (1) construct a 
mathematics curriculum, grades one through seven, which is based on the personal 
interaction of each child with a rich, concrete, mathematical environment, and 
(2) develop a degree in Elementary Education which has about one*»third of the 
time spent on learning mathematics. The mathematical learning would be based 
on laboratory work, concrete manipulation, and inductive principles. 

Research findings in the above project Identified six stages in the 
learning of mathematical abstractions: Stage 1, initial interaction with 
environment, random behavior; Stage 2, awareness of constraints and self- 
imposition of constraints (games); Stage 3, comparison of activities, search 
for isomorphisms or inclusion or exclusion relationships between games learned; 
Stage 4, representation, usually spatially, of the abstractions achieved; Stage 
S, description of properties of representation (eymbolisation process); 
Stage 6, formalization (axioms, theorems, and the like). 
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Nlckel (1971) designed a study to complement Piaget's developmental 
theory* Nickel designed materials which would test three pedagogical methods 
attributed to Piaget. These methods were verbal, intuitive, and active. 
The verbal method relied on use of abstract materials i the spoken and written 
word« The intuitive method utilised representational materials: pictures, 
diagrams, and the like. Xht active method utilised concrete materials: things 
which can be seen, manipulated, and transformed* Three different treatment 
methods were assigned to fifteen different groups of fourth-grade children. 
Treatment one was the control method, treatment two was a strictly verbal 
approach, and treatment three was a multi-experience approach using the 
active, intuitive, and verbal methods* One conclusion deals with the multi- 
experience approach to verbal problem solving. This treatment was demonstrated 
to be significantly more effective than the strictly verbal approach. Generally 
the multi-experience approach proved to be a viable means of implementing 
Piaget*s developmental theory in terms of organised classroom instruction 
for the purposes of improving verbal problem solving* 

Toney (1968) conducted another fourth-grade study. Students were ran- 
domly assigned to one of two treatment gro«jps* Treatment one called for the 
students to individually manipulate the instructional materials* Treatment 
two called for the students to be spectators while the teacher demonstrated 
the same materials as were used in treatment one. An analysis of the data 
for this study suggests the following: First, the data indicate a trend 
toward greater achievement by the group using individually manipulated 
materials, although this was not significant at the .05 level. A second 
conclusion stated that the individually manipulated materials seemed to be 
somewhat more effective in building understanding than the control treatment 
which consisted of teacher demonstration. A third conclusion dealt with 
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th. ,en..ral ^.,^h<.m.ti..s achievement of the two groups. Teacher demonstration 
an.l inatvlrfiul RMnlpuUtlon seemed to be equally effective. 

!<>-ro.-. >\ r::) rt.porioJ on a atuJy involving second gradeirs and sixth 
gra^lors. The treatnient group had one period per week devoted to the mathe- 
mctios laboratory while the control group had no mathematics laboratory 
experience at ail. . The data indicated that no statistically significant 
changes took place, although treatment group means exceeded control group 
means on virtually all the criteria used. The criteria consisted of attitudes 
toward math, ability in problems similar to those encountered in the math 
lab. and achievement on the standardized arithmetic test. Even though those 
students in the experimental group received one less period of arithmetic 
per week, this did not result in lowering their scores on the standardized 
arithmetic test. 

Wilkinson {19;o) conducted a study which used three treatments to teach 
geometry to nine classes of sixth-grade students. Students taught by the 
laboratory method did as well as those taught by the expository method. 
The third treatment group used cassette tapes for instructions. In the 
case of the low l.g. male, significant attitude changes in favor of the 
laboratory treatment were reported. Wilkinson found a tendency for brighter 
students to show a negative attitude toward laboratory materials. The 
findings were not significant at the .05 level. Wilkinson expressed the 
opinion that brighter students may have their thinking slowed when forced to 
use the physical world. The more able student functioned quite well in the 
verbal world, and the use of physical materials seemed to create a negative 
attitude toward mathematics. 
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Schwartz W'^l) reported on the COI^A project for low achievers in 
the Denver ar^M. CCUMDA used the math lab as an approach for teaching the 
low achiever. A study investigated uhti achievement >^ruwth with seventh and 
eighth graders. Two treatments were staffed with COLAMDA teachers. The 
third (T3) was taught by a teacher who had not participated in the project. 
The COLAMDA teachers used the project materials in treatment one (Tl) , but 
did not use project materials in T2. The following conclusions were reported: 
(1) In the seventh grade, the use of COLAMDA materials did not prove to be 
significant in affecting achievement. In the eighth grade, the students who 
were not required to use project materials attained a significantly higher 
level of achievement. (T2 compared with T3) . (2) In a comparison of Tl and 
T3, there was no significant difference between classes which used the materials 
and classes which did not use the materials. In the eighth grade, the classes 
with the teachers who did not use the material attained a significantly higher 
level of achievement than the classes taught by teachers who did use the 
material. 

The next study, Cohen (1970), deals with a group of boys in a middle 
school mathematics program and the comparative effects of laboratory and con- 
ventional mathematics teaching upon achievement and attitude toward mathe- 
matics. While the study did cover thirty-four school days, the content 
centered entirely about fraction concepts and computation. Comparison of 
the difference in achievement between the groups revealed a statistically 
significant Increase in improvement on the part of students taught by the 
conventional approach. The laboratory approach was found to require consider- 
ably more class time than did the conventional treatment. There also was a 
marked difference in favor of the control group with respect to computational 
ability. There was no clear-cut pattern regarding attitude on the part of 
control versus experimental group. 
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Johnson (1970) randomly assigned seventh graders to one of six classes. 
There were three treatments which were randomly assigned. Treatment A 
consiatt^d ot the textbook only, treatment i\ con^iiriced ut exolualve uae of 
Instructional modes other than textbook and was titled '^activity.*' Treatment 
C, which was called enriched, was a syntnesis of the textbook mode and the 
activity mode. Achievement and attitude tests were used to measure the 
outcomes. On the basis of results from tnree achievement tests, Johnson 
suggested the following conclusions: (1) From the data obtained one cannot 
conclude that the exculsive continuous use of activity oriented lesson in 
seventh-grade matnematlcs classes will result in improved achievement over 
exclusive textbook based or activitv enriched instruction* When the activity 
is the dominant feature of the instruction and occupies the great portion of 
class time, then the performance of students on achievement tests appears to 
be inferioi' to the performance of students who have little or no activity 
based learning experience. (2) Ko differences were detected in achievement 
between activity enriched and textbook based instruction* Activity enriched 
was the synthesis of the activity lab oriented treatiient and the textbook 
treatment* (3) A third conclusion dealt with low and middle**ability students; 
these students were probably aided in the learning of some concepts in seventh* 
grade mathematics by the use of activity oriented lessons* Johnson went ou 
to suggest that laboratory lessons in the study of geometry and measurements 
might be appropriate for low and middle-ability students. Finally, the use 
of activity oriented lessons failed to produce any significant differential 
effect between treatment on attitude measures* 

Chandler (1971) reported on a study which examined Experiences in 
M a t hema t ic a 1 Idea s > NCTM (1970). The study measured changes in the learning 
environment as perceived by students > and changes in teaching practices as 
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determined by teachers' opinions, as a result of introducing a bet of 
curriculum ciaterials designed for low achievers* Chandler cites the 
tollowing conclusions: (1) Girls felt the rate oi prcbviitaClon ut lUvas 
In Y>M was matched with their individual characteristics, (2) The scudt^uts 
were not as satisfied with EMI as with their former mathematics program, 
(3) The students felt that £>fl decreased the confusion in the class and 
helped them see the goals of the class. (A) Teacher opinion ot their 
teaching practices were not changed by the use of EMI. (3) Teacher and 
supervisor attitudes toward EMI were positive* 

Shoecraft (1971) reported a study using three treatments. The treatments 
were: Tl - low imagery, T2 - high imagery using materials, and T3 - high 
imagery using drawings* The treatments were used to teach problem solving in 
seventh^* and ninth-grade algebra classes* The materials treatment (T2) 
classes scored the best on transfer instruments. For seventh-grade students 
categorized to upper, middle, and lower arithmetic levels, the diagram treat- 
ment (T3) was associated with the lowest performance among the middle one- 
third, and the materials treatment (T2} was associated with highest performance 
among the lower one-third. For ninth-grade students, Tl was favored among 
the upper one-third and T2 was f:4V0red among the lowest one-third* Shoecraft 
concluded that low achievers seem to derive particular benefit from represent- 
ing problems using materials. The other two achievement levels seemed to 
derive no benefit from materials. 

In an extensive project of teaching of mathematics through science by 
SMSG, more than 12,000 (seventh, eighth, and ninth) grade children studied 
special materials written by a team of mathematicians, scientists, and teachers 
Higgins (1969) conducted a study of the students of 29 eighth--grade mathematics 
teachers from Junior high schools in Santa Clara County, California, as they 
taught a unit entitled "Graphing, Equations, and Linear Functions." 
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There were 853 siudenta in the experiment. At tht; concluBlon of the ex- 
periment, the studtfnta were grouped in eight "natural" attitude groups s^uch 
that a! I ..-r! ilv .■hiivirun in a t;ivvr. gioiiji hud simil.u altitudes tuw.Jid 
nathenatics. It waa found that dirferences in attitude patterns among 
groups were not reflected in significant differences in either ability or 
achievement* It was concluded that attitude cliange clusterings were not a 
major consideration if one is concerned witij mathematics achievement during 
a unit taught via physical approaches. The study found about six percent of 
the children developing rather strong cohesive unfavorable attitudes toward 
the content. At the otiier end, he found eight percent of the children develop- 
ing attitude shifts favorable toward mathematics, but in general, most students 
changed attitudes verv little. Some liked the unit; some liked it, but found 
it harUer; others found it easier, but less interesting; and a few disliked 
it quite str a^ly. 

In addition to the above studies, other studies combined films, film- 
strips, computer assisted instruction, programmed instruction, and the like 
with other manipulative laboratory oriented materials. It is difficult 
enough to design a study to manipulate a. single variable. It is almost 
impossible to tease out the significant' effects when a synthesis of many 
different teaching strategies and materials takes place within what is 
identified as a single treatment. 

The next section of this paper contains a report of research that deals 
with a micro-instructional use of the mathematics laboratory. For the purposes 
of this paper, micro-instructional will apply when there is a single mathe- 
matical content idea and the period of instruction is fewer than twenty 
days. 
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Moody, Ahell, and Bausell (1971) reportt»a on a situdy of ninety third- 
grdde BCuQiints. The majority of the subjects came trom lower middle socio* 
economic tamiilf^. Theae ninety subjects were randv-My a.:signed to four treat- 
ments. One treatment consisted of an activity oriented setting In which the 
subjects manipulated instructional materials. A second treacment consisted of 
a rote treatment where the emphasis was placed upon memorizing basic multipli- 
cation facts and algorithms. A third treatment consisted of a rote word 
problem treatment wnere the instruction was the same as in the rote treatment. 
The third treatment also included practice in solving multiplication worded 
problems. The control group received instruction in addition* The results 
indicate that activity oriented instruction did not result in superior original 
learning at the .05 level when compared to the other two treatments. It was 
also found that the additional instruction in the solving of worded problems 
did not significantly affect computational performance involving basic facts. 
Difference scores between a pre-test and a post-test indicated that instruction 
in the solving of worded problems did not result in superior worded problem 
performance and also that activity oriented instruction did not result in 
superior transfer compared to the other instructional methods. In the matter 
of retention, there was no significant difference between the activity 
oriented instruction and the other two treatments on the retention of multipli- 
cation facts. In general, the authors pointed out that all treatments failed 
to affect transfer of learned computational skill to worded problems involving 
identical computational requirements. Subjects who were specifically taught 
worded problems did not manifest a trend towards superior performance 
immediately following instruction. On the basis of this study, it was concluded 
that the activity oriented instruction did not result in higher original 
learning, higher transfer, or higher retention of the instructional content. 
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TrutVol.00%1 (19o7) as8ign**d sub.lecta, aged nine to eleven, to two 
Ultttircnt trt*at«it*nt gruups. Treatment one Involved the actual manipulation 
^•t vi-^ual ti.:iilL' lias while troatnt-nt two oalU'cl tor the subjects to observe 
and tell the teacher how ta manipulate such devices* The result of the 
statistical analysis indicated that pupils taught by the demonstration method 
scored higher on the irmnediate post-test than pupils who manipulated the 
visual tactile aids. The significance was at the .10 level. Both Tl and 
11 had a high degree of retention. 

A second demuhstration-comparison type study dealt with fifth graders, 
BlsLv> (1970). This study concerned itself with the teaching of addition and 
subtraction '>f like fractions to fifth-grade pupils. In treatment one* neither 
the teacher nor the students used manipulative materials while in treatment 
two* the teacher used manipulative materials as a demonstration. In treatment 
three t both teachers and pupils used the manipulative materials. An analysis 
of co-'variance design was used and the following conclusions were cited by 
the author. Children taught to add and subtract like fractions with manipula- 
tive materials* wnether they were demonstrated or actually used by the child* 
were at least equal in measures to children taught by a method not involving 
manipulative materials. A second general obsetvation seems to be that the 
demonstration cf nanipulative materials on the part of the teacher appeared 
to be as effective as the actual experience using manipulative materials on 
the part of the student, and both of these were better than the absence of 
the manipulative materials. 

Green (1969) combined two interpretations of fractional number with two 
different kinds of instructional materials. The instructional materials were 
diagrams and cardboard strips labeled "materials." It was concluded that 
diagrams and "materials" were equally effective in learning multiplication of 
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fractioiMl numbers, A se^^ond ohservat fun .ieatt with rho fact that, the 
tttudfnts 'i.sin^ tha di^igruin tivhniqufs Ilkt-d those techniques significantly 
hetttT vU.vx "h*^ stuiifMif^ vho were tiding rho mnlpul ii fvo matorlals. 

Cirm.Miv M970) reported on a study whirh lnve;Kt igatod the role of 
concrete .\i\d seml-oonv-rete materials In the teaching of elementAry school 
machenatiis, Thr^e sixth-grade classes apent eleven class periods In this 
experiment. Three treatment groups were set up— one used concrete aids, a 
second trentTrenr croup used semi-concrete aids, and a third group used no aids 
at all. In General* the results favored the semi-concrete and concrete groups 
over tho symbolic ^^roiip. There was no significant difference between the 
concretti and seial-concrete groups. The experiment supported the use of concrete 
or semi-concrete materials If the goal is transfer. The study emphasized the 
Importance of h.ivlnt? specific oehavloral objectives foi' the uSe of conctets 
aids and of recognising the many factors that must be considered In deciding 
on their usage* The necessity of distinguishing between the physical situation 
to which a mathematical concept Is related and the media used for establishing 
the relationships was also Indicated by the study. 

The next section deals with muthematics laboratories as an Integral part 
of content or methods courses for prospective elementary school teachers. 
Smith (1970) reported on an experiment which was to determine whether labora** 
tory experiences Improved the performance of undergraduate students In an 
Introductory course In abstract modern mathematics. There were four treatment 
groups— a control wroup and three experimental groups. The control group 
class had four lecture sessions per week, while the experimental groups had 
one, two, or three laborauory periods per week In addition to lecture sessions 
for a max imam of four class meetings per week. It was concluded that the 
laboratory experience of the three experimental groups did facilitate learning 
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of concepta and improvod the retention of those concepts slKnificantly. 
Smith also noted that even though college students are in the formal stafio of 
operati.-ns. it «..v stiU bo th. ...so that th..-y leuru a dis<:j,.U,u. bKt.r whoo 
they move tron concrete to abstract by means of physical materials and models. 

Postman (1971) also examined the effect of a mathematics laboratory on 
the teaching behavior of preservice elementary school teachers. Four compo- 
nents ot the laboratory approach were identified: (1) active use of concrete 
materials by students. (2) the guided discovery approach. (3) students work- 
ing independently as individuals or in small groups, and (4) the teacher 
directing her comments to individuals or small groups. Teachers were video 
taped while teaching a topic. Next, the experimental group of teachers was 
sectioned off into a six-week laboratory experience as a part of the methods 
course. The contri-i group did not receive laboratory experiences in the 
methods course. Because the sample was small, a statistical design was not 
reported. There was a tendency for students who had received the laboratory 
activities instruction, as a part of the methods class, to talk less and use 
materials more in the post-test observation. It appears that the mere involve- 
ment in laboratory experiences at the preservice level is not sufficient to 
cause teachers to use the laboratory approach. Postman does point to the 
potential that the laboratory approach may have in the changing of teacher 
behavior . 

Boonstra (1970) conducted a study at Michigan State with the purpose of 
studying, recording, and analyzing the classroom behavior of student teachers 
who had been given two mathematics laboratory experiences. The study answered 
two basic questions: (1) Do student teachers who have been taught a concept 
in a mathematics laboratory use manipulative materials as they teach the same 
concept? (2) Do student teachers who have experienced a student centered 
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iearnln^ sitUHtion in a mathematics laboratory employ a student centered 
t^achinji approach aa they teach? On the ba«is of this study, it was concluded 
that two prc^tirvtce ciari»t;s iiuorporatiii^ laboraiury t^xpc-r luncea are not 
sufficient to affect the teaching behavior of student teachers* The laboratory 
experiences did not result in the use of manipulative materials and iid not 
at fee * the dominant role of the teacher in the classrooms observed. 

Hendrickson (1970) reported a study dealing with the preservice education 
of elementary teachers. Three treatments were used in the course. One 
treatment used a math lab, a second treatment used an enrichment approach, 
while the third trt;atment was a conventional approach* There were no signifi- 
cant differences between the three groups in achievement* The conventional 
group showed a significant attitude gain. 

David Fitzgerald (19/1) reported on a study conducted at the University 
of Houston which investigated the effect of a mathematics laboratory upon the 
performance of prospective elementary teachers enrolled in a mathematics class 
for elementary teachers. The investigation consisted of the comparison of 
the effect of a mathematics laboratory teaching technique to the effect of a 
traditional lecture-discussion teaching technique. Statistically there was no 
difference between the groups which had participated in laboratory activities 
and the groups which had participated in lecture only in terms of the achieve- 
ment in the course. However » those in the treatment group had received only 
one-half uf the lecture time as those in the control group; therefore, it can 
be concluded that the laboratory experiences can be included in the preservice 
experience without causing poor performance or poor attitudes on the part of 
the prospective teachers. In every instance the ptsrformance and attitude 
of the teachers who had the laboratory experiences were slightly better though 
not statistically significant. Wilkinson found similar results in an 
unpublished study at the University of Northern Iowa. 
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In thtj Judgiucnt or thU writer, it would appear that our hvst hope would 
be to teach sovoral oi tho coursos in tht^ proservic-e mathenuiticai t>xpcrience 
witii a lahoratt-ry str.icej^y a.s aii iut^'yj.i] part of tho variety o: stratvKivrf 
that wu as collegiate it^vel people ust* to teach content and methods courses. 
We should model the durato^^y which we want to impatt to tho prospective teachers. 

Douthltt (1971) reported on a study whose purpose was to design an effec- 
tive laboratory in college freshman mathematics. One hundred fifty "high 
risk*' students in an analytic geometry course at the University of Houston 
were the subjects. The following conclusions seem noteworthy: 

1# A niauhenuitlcs laboratory can produce: 

a) higher achievement 

b) more positive attitude scores 

c) .1 lower failure-withdrawal rate 

2. The e.xpository method does not seem to result in the coverage of 
more course content* 

Bluraan (1971) reported on the nuithematics laboratory as a part of the 
community college mathematics program and the results of his study indicate 
that there wert no differences in student achievement as a result of mathematics 
laboratory but that there were more favorable attitudes toward mathematics 
cn the part of those students that used the laboratory method. 

As part of the Specialized Teacher Project in California, which is one 
of the Militi Mathematics Improvement Projects, Frank (197C) published a 
report which summarizes the special training sessions for in-service teachers 
held during the summer. These sessions stressed individualized learning 
experiences and the techniques employed in using mathematical possibilities 
in the environment, as well as physical materials in a mathematics laboratory 
setting. Results of the pre- and post-testing of pupils showed that the 
teacher training had a very strong effect on pupil mathematical achievement 
in grade two, particularly on those pupils from low socio-economic areas. 
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In grade five, the effect was more limited with achievement gains significant 
In certain new noplcs Introduced In the sutmaer training. In a subsequent 
summer, 1969, an analysis of the results of the pre- and post-testing during 
1969-1970 revealed that pupils whose teachers received In-servlce training 
scored significantly higher on measure of comprehension and computation. 
Again^ the project was particularly effective with pupils from low socio- 
economic areas* Both the second- and fifth-grade pupils made si^^n; f leant 
gains on nine of the ten skills measured* 

In all of the above research which used analysis of variance oi analysis 
of covar lance design^ the F statistic was the only measure of variance compari- 
son reported* The writer suggests chat Che *Wltiple R^" is more easily 
understood by the average reader and just Hu '^^.^kif.ngfu^ to the sophisticated 
researcher. The search for significance at the .05 level is greatly enhanced 
by tiaving a large sample in the study. Often results are reported as 
significant at the .03 level when by looking at the multiple R*": we find 4 
or 5% of the variance attributable to that effect. The multiple R^ is defined 
to be (SS due to regression) -f (Total SS corrected). The measures the 
proportion of total variation about the mean explained by the source* It is 
easily computed and would be meaningful if reported with the standard 
AXOVA tables. 

Ill 

In the Judgment of this writer, the research on math labs and activity 
learning does reveal some trends* They are: 

a) Math labs seem to produce favorable achievement gains in primary 
age children. The usual comparison treatments are pencil and paper 
or expository* The favorable results are not generally present in 
studies dealing with older children* 
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b) Math iabs seem to produce tdvorabie achifevemunt gains xathe leas 
able elementary a^e ehiid. The favorable results are not generally 
preaeut in groups or average or above-averatje ability. 

c) Math iabs do not seem to have uny differential eifect on attitudes 
of elementary or Junior high students. 

d) Demonstration tieacnients using activity oriented mattrialb seem to 
be a» eftective as "hanus-on'* treatments^ 

e) Viewing math iabs as a teaching strategy and selecting that strategy 
when it seems more appropriate than others in a teacher's "repertoire" 
seems to hold more promise than adopting a lab approach to a large 
body of content without regard lor the compatibility oi content and 
teaching strategy, 

f; Math labs show promise as a strategy to teach pre-servlce clabses 
ill mathematics methous* 

i would be presumptuous and naive to ».,ssert that the above bear any 
great resembiaiictiS to fact. As a community of mathematics educators, we 
need to identify what it is that we know to be f'lcts, what we know to be 
opinions, and what are our fantasies. No single researcher, institution, or 
grwup can perform this task. It will take cooperation, insight, and hard 
work. We must get a narrow focus on the issues and provide many replications. 
In this way, we may more clearly identify the facts, opinions, and fantasies 
dealing with mathematical learning and mathematics laboratories. 
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MATHE>L\TICS LABORATORY EVALUATION 

MathemHticfci laboratories In one torm or another at one level or another 
are currently a major Interest of mathematlrH educators throughout the world. 
A natural conaeauence of this Interest Is a call for evaluation. This paper 
l8 concerned with the evaluation of mathematics laboratory projects. It wilj. 
report on several project evaluations; It will discuss the difficulties In 
evaluatlnj? laboratory projects; and It will outline some possible directions 
for the future of mathematics laboratory evaluations. 
Iate_rest_ln Matheniatlcs Laboratories 

No one who has attended any recent meeting dealing with mathematics 
Instruction will demand additional evidence of the Interest In mathematics 
laboratories. The programs swell with talks and workshops that are at least 
tangentlally related to someone's definition of a mathematics laboratory. 
The commercial exhibits have blocks, cubes, rods and mirrors, and publishing 
houses are looking for manuscripts dealing with laboratory Instruction. 

There seem to be several forces contributing to this push for mathe- 
matics laboratories. Some Innovators believe that the research of Plaget 
and his Geneva Group has provided a rationale for an Instructional strategy 
that Involves concrete embodiments of abstract concepts. Moreover, men 
like Bruner and Dlenes have lent support through their writings and 
research to the notion that the laboratory may be an appropriate strategy 
for mathematical learning. In acknowledged response to some of these 
forces, the Nuffield Foundation In England has made possible the develop- 
ment of one extensive model of mathematics laboratory Instruction. The 
creative and attractive materials developed by the Nuffield Foundation 
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and glowing reports of their ett'ectlveness have, thenmelves, supplied a 
force for further laboratory activity. 

In the United States the reu Lizatioa that the mathoiiiatii.-a curriculum 
reforia of the 60*s has not had Che impact on child learning that was 
hoped for has inspired a search for a new pedagogy. Some of the searchers 
have found the new that they seek among the old. The mathematics laboratory 
has a long history in both writing and action in this country. In his oft- 
quoted and now seemingly prophetic presidential address to the American 
^Uthematical Society in 1902, E- H, Moore asked Would it not be possible 

for the children in the grades to be trained in the power of observation, 
experimentation, reflection, and deduction so that always their mathematics 
would be directly connected with matters of thoroughly concrete character?..." 
The seventy years since Professor Moore's talk have been spotted with con- 
siderable writing about laboratories and many laboratoiy projects. But it 
does seem that interest in laboratories has achieved at least a local maximum 
at this time. 
^ J^'eed for Evaluatio n 

Despite all of the forces fostering mathematics laboratory instruction, 
the average mathematics class at every level is conducted in 1972 pretty 
much as it has been for 70 years. There may be a few more materials on 
the shelves of some elementary classrooms. There may even be a weekly 
game period which exhibits a non-directedness which tends to be associated 
with laboratories. But there are very few classrooms at any level that are 
being conducted according to a laboratory strategy. It would certainly be 
naive to lay all of the blame for this situation on the lack of laboratory 
evaluation. There is, however, a posture of skepticism and a demand for 
accountability that prevails in this country. Innovators, in particular those 
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who advocate n:athcmitics laboratories, are pressed to support their positions 
with hard data. Unfortunately^ such Innovations tend to be regarded as threats 

to t'xifUii'ri pri»>;rar.6 rather than as alteniative a, the bt^at uf which should 
be asslmllaced* 

The fact that a mathematics laboratory strategy generally Implies a 
hl^jher degree ot* classroom organization, that It suggests additional expendi- 
tures for equipment, and that It questions existing mathematics priorities 
pur.s the advov.'ati- of mathematics laboratories under additional pressure to 
sujjport his position with evaluative data. Furthermore, the serious educator 
wants objo»:tive answers to questions that have been raised concerning the 
laboratory strategy of Instruction, 

In an attempt to determine just what Is being done toward evaluating 
the laboratory strategy of teaching, the authors have Identified certain 
laboratory projects throughout the world. In the following pages we will put 
forward a definition of mathematics laboratory; we will report on selected 
projects and their evaluation; and we will make some comments concerning 
problems and possible directions for laboratory evaluation. 
P roced u res for This Pa^er 

In order to learn of some mathematics laboratory projects and their 
evaluation the authors devised a questionnaire. This was sent to a list of 
people which was compiled from 

1. AAAS 7th Clearinghouse Report, 1970 

2. Personal acquaintance 

3* Suggestions from respondents to the questionnaire* 
in mailing the questionnaire we were not very restrictive In our definition 
of a laboratory. We Included any project or Individual that came to our 
attention as being Involved In something that would satisfy someone*s 
definition of a mathematics laboratory* 
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However, in deoidin« which projects to report on in this paper It watt 
neceftsary to agree on sone r.jt»«inln^t'ul ♦ yet not too rt?strictive, definition of 
J mathc'Tnatii-s 1 ah. oratory. Many ut ovr qiu'^*tlotinaiit' U'SUoiuU'Mts bad g{v*»n 
considt»rahle thought ro a definition and our thought was colored by theirs. 

The mathematics laboratory has to do with muthematics and its implications 
in and relationships to the real world. It also has to do with learning by 
doing rather than by being told. There is not general agreement as to exactly 
what kind of "doing" should go on in a mathematics laboratory. There seems 
to be a continuum on which most definitionb fit. On one end is a highly 
structured learning strategy involving planned experiences with concrete 
embodiments of certain mathematical concepts. On the other end is a totally 
unstructured opon-ended involvement in loosely defined real-world situations. 
Reason seems to suggest that some ingredients from each extreme should be 
employed in devising a mathematics learning strategy. 

For the purposes of this paper it seems desirable to be as inclusive as 
possible in defining laboratory strategy of instruction. Hence the following! 
De f inition 

The mathematics laboratory is a strategy of instruction in which the 
learner himself interacts with mathematics and its real-world applications. 
The techniques used in a laboratory strategy may be varied; they may include 
discussion, discovery activities, model construction or even some directed 
teaching. Likewise the interaction of the learner with mathematics and its 
applications may vary. But the laboratory strategy focuses the learner's 
attention and activities on the relationship between mathematics and its 
real«*world applications. 
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Tht? projects discusaed below were selected according to the following 
criteria: 

I. the authoiji* awarenetib the project 

the above definition of mathematicH laboratory 
3. the presence of a serious attempt at evaluation* 
H. the apparent quality and importance of the project 
5. the debire for diversity in projects mentioned. 
Criterion 1 was mentioned because of the conviction of the authors that they 
have probably overlooked several very significant projects. There is no claim 
for cumpleteness in this survey, and the authors are anxious to have other 
projects brought tc their attention. In the process of selection, certain, 
important pioneering projects have been omitted because of their lack of evalua- 
tion. This lack is easily understood in such ventures because they are usually 
under-financed and directed by comnitted and involved individuals who lack 
either the time or the training for systematic evaluation. Also some projects 
are at t^o early a stage for buraraative evaluation. Such projects include the 
Laboratory teacher training projects of Professor Dora Skyp^ck at Emory 
Iniversity and Professor Robert Revs at the University of Missouri, the 
laboratories of Professor William Fitzgerald at Michigan State University and 
in the East Lansing schools, the learning center mathematics program in the 
Wlnnetka Schools directed by Dr. Lola May. the multilingual mathematics programs 
of the Southwest Regional Laboratory directed by Kelly Hamby in consultation 
with Professor Clenadlne Gibb. and the Mathematics Specialist Internship 
Program at Teachers College of Colombia University under the direction of 



* This paper will concentrate or. the summative evaluation of projects 
rather than on their formative evaluation* 
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Professors Rosskopf and Kaplan, and the Compriihent^ive School Mathematics 

Program of CEMREL under the direction of Burt Kaufman* 

Seven Mathematics Laboratory Projects and Their Evaluation 

I. COLAMDA PROJECT 

Terry Shoemaker, director 
Douglas County School District 
Castle Rock, Colorado 

COLAMDA (Committee on Low Achievers In Mathematics - Denver Area) Is a 
teacher training project for teachers of low-achieving junior high and senior 
high students. This Title III funded project has a small pre-servlce component, 
but Its main energies seem to be directed toward Implementing a detailed ln«* 
service training model. This model Is designed to modify teacher attitude 
toward slow learners ai.d to Introduce the teacher to a wealth of laboratory 
materials that can be used with slow learners. A snowballing effect is achieved 
by having teachers who have been trained In the project train new teachers* 

Among the projects we have surveyed COLAMDA has given \musual attention 
to evaluation. The project has an evaluator, Mr. Dan Colvln and an evaluation 
consultant. Dr. Doug Smogren, The most extensive evaluation reported occurred 
In the year 1970-1971. This evaluation will be reported here* 

Principal foci of this evaluation were student attitude and achievement, 
teacher attitude, and project Implementation. Student achievement was 
measured by the Stanford Achievement Test in a pre-test - post-test design 
In which regression to the mean was controlled. The results Indicated that 
there were gains that could not be accounted for by maturation and which were 
not typical of the population. On these tests as well as on a test designed 
for topics specifically taught by the project teachers there was a serious 
problem with getting complete data from properly administered Instruments. 
A semantic differential scale was used to measure student and teacher attitudes 
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toward ideas and thlnga relevant to the program. It was found that pre- and 

post-teat scores were high for both groi.ps on most items. A questionnaire 

was used to determine the extent to which specific aspects of the COLAMDA 

materials were implemented in the classrooms of teachers who were trained 

by the project. Also, questionnaires were used to determine the impact of 

workshops on teachers and informational luncheons on principals. 

The COLAMDA evaluation does reflect gains. It ie worth noting, however. 

that this evaluation was effected by trained evaluators who devoted a great 

deal of time and money to the evaluation. Even under these conditions the 

evaluators reported some problems in getting complete and accurate data. 

II. Specialized Teacher Project 
Leonard W, Warren, Director 
Department of Education 
San Diego, California 

The Speciali2ed Teacher Project, one of California's Miller Mathematics 
Improvement Programs provides volunteer elementary teachers with a two week 
summer workshop which is designed on a laboratory format. In addition to 
the training, each teacher is given an allowance for the purchase of some 
laboratory materials to take back to her classroom. The director feels that 
this allowance greatly increases the probability of implementation of new 
techniques learned. The participating teachers are also urged to trade off 
with another teacher so that they will be teaching mathematics to two elemen- 
tary classes upon return. This project has trained more than 3,000 teachers 
during the last four years and has effected extensive evaluation. 

As with the COLAMDA project the focus of the testing was on the pupils 
of the teachers rather than on the teachers themselves. Pupils were tested 
at grade levels two and five. In grade two the test battery consisted of 
basic tests of mathematical comprehension and computational ability. These 
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tests were modified by the addition of more difficult itemb for the post- 
testing. For the fifth graders selected scales from the National Longitudinal 
Study oi Mathematics Achievement were used for pre- and post- tests. "These 
tests covered understanding as well as coaputational ability in the areas of 
whole number operations, operations with fractions, and informal geometric 
ideas. A special achievement test covering graphs, functions, and probability 
was administered in the spring. Those particular areas had been emphasized 
in the in-service training and in the instructional program for the fifth 
grade# In grade 5 a selected set of attitude scales was also administered^ 

The results on the achievement tests showed significant achievement 
gains in the experimental group over the control group for both grade levels 
tested. The gain for the second grade was, however, greater than that for the 
fifth grade. As is frequently the case there was not a significant attitude 
gain except for those children whose classes were in disadvantaged areas* 

The training for the teachers in this program had, of course, many goals 
which did not get measured. Nor was any measure taken (or at least reported) 
on a change of teaching technique by the participating teachers. This evalua- 
tion, under the direction of Robert Dilworth, does seem to have been thorough 
and careful and seems to have demonstrated the effectiveness of the program* 

HI, USMES 

Earle Lomon, Director 
Educational Development Center 
33 Chapel Street 
Newton» Massachusetts 

The Unified Science and Mathematics for Elementary Schools (USMES) 

project has developed some laboratory materials that appear to be near the 

open-ended, undirected end of the strategy continuum proposed earlier* As 

an outgrowth of the Cambridge Conference on the Correlation of Mathematics 

and Science in the Schools (1967), the USMES project was funded by the 
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National Science Foundation. The project materials are built around a 
series of challenges to the student, for example: 

~ How can you make practical fair dice for different numbers of 
players? 

— How can you design and build at reasonable cost a burglar alarm 
which Would give adequate warning? 

~ What Is the best description to help In picking a person out of a 
crowd at the airport or bus station or to help In finding au 
amnesia victim or other missing person? 

— • How would you Improve the safety and convenience of a pedestrian 
crossing? 

— - How would you Improve your cafeteria service? 

The USiMES materials Include the challenges, skill cards to help a 
student with technical problems that he encounters In trying to answer his 
challenge, the plans for a design laboratory for the stuoent to work in, 
and materials to help a teacher organize and facilitate student participation 
in the program. The materials are now being tried with elementary pupils at 
various locations throughout the country, and they are being used in pre- 
service teacher training at the California State College at Bakersfield 
and at Michigan State University* 

The arithmetic and reading comprehension subtests of the California 
Test Battery are being applied to 50 USMES classes and 50 control classes 
this year on a pre^test - mid-test - post-test basis. The project is also 
collecting observational data from teachers and outside observers. Most 
interesting, though, is the problem test which is being applied to a small 
random sample from each of the 100 classes. The student is asked to help 
the school to make a decision on which of three exercise books (notebooks) 
the school should buy for the students to use in science and mathematics 
clasjes. The student is told that he has 30 minutes and that he will be 
given any information that he asks for. He is asked to record in writing 
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or veroaily tne steps that he goes througn to make a declaion. The obaerver 
is askea to note such thint^s as the number ot measurements, tools used, 
accuracy ot measurements, number of comparative calculations, data used In 
calculations, questions and statements of students, number of times instruc- 
tions neea to be repeated, elapsed time to selection of first of three books, 
elapsea time to final selection* 

This latter technique of evaluation has obvious implications for the 
evaluation ot matnematics laboratories* It is tailored specifically for an 
objeccxve that is near to the heart of many laboratory advocates, namely, 
improving the abilities of students in solving real, open-ended problems. 
The evaluation design of the USMES project is still in the developmental 
stage under the direction of Professor Bernard Shapiro of Boston University* 
It bears watching by those who are interested in mathematics laboratory 
evaluation* 

IV. The Nuffield Mathematics Project 
Geoffrey Matthews, Director 
Chelsea College, University of London 
London, England 

The Nuffield Mathematics Project in England was formally begun in 1964 
and has since been developing a series of materials for teaching mathematics 
in an open-ended inquiry setting with a great deal of focus on one's environ- 
ment and one's interaction with it. This most famous of mathematics laboratory 
projects has been the source of a great deal of interest and controversy in 
this country. Its dedication to process goals and lack of controlled 
evaluation of those goals have added fuel to the fire. 

Of interest to this paper is the fact that the Nuffield Mathematics 
Project has appointed Mr. Murray Ward of the University of Reading to direct 
an evaluation of the project* He has not as yet formulated how he will 
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carry out hie evaluation* He lo vlaltlng schools, teacher centers, and 

projects that have developed materials to determine the nature and scope 

ot the evaluation program. The results of this evaluation seem several 

years away but will be of the greatest interest. 

V. WYMOLAMP Project 

David Flory, Director 
River ton Schools 
River ton » Wyoming 

The WYMOLAMP Project is related to the COLAMDA Project in origins and 

objectives. It has as its goals attitude change and skill improvement in 

mathematics for K-12 (pre-algebra) disadvantaged students. The project has 

developed activity packets with manipulative materials for skill development 

in younger (K-6) children, and it has developed occupational mathematics 

packets which are designed to increase skills which might be of use in 

particular occupations. As with the COLAMDA project, WYMOLAMP devotes 

considerable energy to developing teacher attitudes and skills for handling 

the problems of low-achievers in mathematics* 

Project evaluation includes attitude questionnaires and some interesting 

Individually administered tests. In these tests the child was given an 

opportunity to respond to a problem at several levels of abstraction. It 

was found that many of the children could solve certain problems by manipulating 

a physical referent but could not solve an equivalent problem symbolically. 

The interesting feature of these manipulative tests is that they were 

particularly tailored to the skill development strategy of the project* 

VI. Institute for Research in Psychomathematics 
Zoltan P, Dienes, Director 
University of Sherbrooke 
Sherbrooke, Quebec 

Another laboratory project which, like the Nuffield Project, has had a 

great impact on the mathematics laboratory movement is that of Professor 
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2oUdn Dlent-i at the University of Sherbrook in guebei* province. Professor 
Dleneti has the full scope ot tnathenuu Ics education activities In progress. 
Bulk iiround a theory which states, in part, that chiUren learn abstract 
concepts by discovering isomorphisms between multiple embodiments of those 
concepts, the Institute has a program of research in child learning, a 
materials development program, a pre-servlce teacher training program and 
an in-service teacher training program* Children are taught In several 
local schools via the multiple embodiment principle. 

Frotessor Dlenes has had at least some Influence In the development of 
projects thi't)ughout the world Including the Canary Islands, Australia, England, 
several European countries, San Diego and Philadelphia. 

Statistical evaluation has not been a major thrust of the Dlenes projects. 

In Sherbrooke, 9 year olds In the Dienes program were compared with those in 

regular classes on achievement tests which are tailored to school objectives. 

The Dlenes children were reported to have done equally well on computational 

skills and better on problem solving than the control students. Dlenes himself 

feels that one needs bat walk Into one of his classes, and one will be con** 

vlnced that the children are engaged In profitable mathematical activity. 

VII. TTT Mathematics Systems Laboratory 
Vlggo P. Hansen, Director 
San Fernando Valley State College 
Northridge, California 

The TTT Mathematics Systems Laboratory at San Fernando Valley State 

College Is unique in several respects. The most relevant uniqueness Is that 

it has had a high degree of success with an outside evaluator. For the 

fairly nominal fee of $5,000 the Research Bureau of the California Teachers 

Association developed questionnaire and Interview Instruments and administered 

them to the student teachers trained by the project, their supervising 

teachers, the college personnel Involved, public school administrators, and 



ERIC 



-75- 

various people from the conmunlty. Psychologists were hired to do the Inter- 
viewing. The e valuator 8 found that the respondents to the questionnaires 
and Interviews were very enthusiastic about the project. 

In this TTT project the prospective Junior high school teachers receive 
their methods and practice teaching experiences at the same time In the schools. 
The mathematics component Is handled entirely In a laboratory setting^ with 
lessons Involving manipulative devices and open-ended activities. Another 
unique feature of this program is its use of the computer as a tool in record 
keeping, diagnosis and prescription. The added cost that a computer Introduces 
makes the project directors particularly sensitive to the need for evaluation 
to provide accountability for the additional expenditures. 

In addition to the funded evaluation activities the fifth-grade children 
who were taught by project students were pre- and post-tested on the 1956 
basic skills component of the Stanford Achievement Test. Significant gains 
were recorded. The project hopes to develop further evaluative Instruments 
Including such unobtrusive measures as time-on-task« 
Summary of Listed Project Evaluations 

The projects reported had differing goals, different levels of funding, 
different local problems, and each came up with a different approach to its 
evaluation. One commonality among those projects that reported some satis- 
faction with their evaluation is that their evaluation design was tailored 
specifically to the goals of the project, and their evaluative instruments 
tended to be sensitive to those goals. 

The Specialized Teacher Project recognized that, while it was training 
teachers, its principal goal was improved achievement of pupils. So the 
evaluators went to the pupils to measure the effectiveness of the program. 
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The evaluators of the TIT Program at San Fernando Valley State College 
felt that existing paper-and-pencil and observational instruments were going 
to be insensitive to the goals of that project* They were also faced with 
the serious time-lag and geographic distribution problems of measuring the 
impact of pre-service teacher preparation on the subsequent performance of 
graduates* In this case the evaluators chose to sacrifice "cleanness" of 
evaluation design for the sensitivity of questionnaires and interviews. If 
well thought out» this design seems to make sense for early evaluation of a 
project since it can yield considerable formative information. But it does 
not so easily produce those all-convincing means and correlation coefficienta. 

The COLAMDA and WYHOLAMP projects both went to their ultimate goal, the 
pupils* for their evaluation* despite the fact that the treatment group 
consisted of teachers* WYMOLAMF actually designed test instruments to measure 
the pupil's performance on the concrete materials with which he was trained* 

It is not difficult to appreciate the concern that led the USMES evaluators 
to devise an instrument that was very specific to their project. The goals of 
flexibility* open-ended problem solving techniques* and analytic skills would 
certainly not be reflected in scores on any of the standardized achievement 
tests* Tt'ie USMES problem situation instrument seems to show some promise of 
providing a new direction in the development of instruments for mathematics 
laboratory evaluation. 

One message* then* is that individually tailored evaluations are needed 
which employ instruments that are sensitive to project goals* We now consider 
the implications of this message for the design of mathematics laboratory 
evaluation* 
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Arttculation of Goals 

One implication is that a clear definition of goals must precede 
effective evaluation. However, as the cliche Ho aptly puts it» "this is easier 
said than done," Most laboratory projects share some of the traditional 
achievement goals with other strategies of instruction. These goals have been 
carefully thought out and many of them have been articulated in behavioral 
terms. The evaluation ox these goals should present few problems. 

However, most mathematics laboratory projects have other goals. These 
nay include confidence, flexibility, positive attitude, and problem solving 
procetfs skills, all to be exhibited In the context of mathematics. Clearly, 
such goals are most difficult to express in behavioral terms. And yet, it 
is exactly these goals that motivate the development of most mathematics 
laboratories* So they must be articulated and they must be evaluated. 
Sensitive Instruments 

Again the traditional goals, at least for children, present fewer 
problems* Standardized achievement tests abound. Unfortunately, many 
evaluations that employ these instruments in a comparative design seem to 
find no significant difference between experimental group and control group. 
There is some question as to whether the usual paper-and-pencil test puts a 
laboratory-trained child at a disadvantage. It may be that the traditional 
goals could be measured by instruments that are more compatible with the 
laboratory strategy of instruction. Possibly, for some laboratories an 
instrument that would measure these goals in an activity setting would be more 
appropriate. However, like it or not, one of the pressures for the evaluation 
of mathematics laboratories is to demonstrate to education decision makers 
that laboratories do not sacrifice traditional skills in their pursuit of 
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other goals* There is probably nothing that could be as effective to that 
«nd as demonstrating sizeable gains on recognized standardized tests. 

It seems^ however, that the evaluation of the set of process and 
affective goals is going to require some very creative instrument construe- 
tlon. Fortunately, considerable energy is already being expended by evaluators 
on the development of alternatives to paper-and-pencil tests* Many such sensi- 
tive instruments as the USMKS problem solving test must be developed* Observa- 
tional techniques, self reports, interviews, interaction with computers in 
simulated problem solving situations and other, as yet unknown, techniques 
may prove to be helpful* 
Defining the Audience * 

An obvious and very important first step for evaluation which some 
projects overlook Is that of deciding for whom the evaluation is being done* 
That is, the evaluators and the project director must decide to whom they 
are going to demonstrate the project's effectiveness* Is it taxpayers, parents, 
scientists. National Science Foundation administrators, or is it Just the 
project staff and local school personnel that are to comprise the audience for 
the evaluation? For some, testimonial would be the most convincing argument 
for or against a project's effectiveness* For others, clean statistical 
data collected under controlled conditions is the least that will be accepted* 
One must enter into the epistemological consideration of what constitutes 
"knowing'' for people with various points of view. Agreement between project 
director and evaluator on the audience and the audience's criteria for knowing 
could provide a clear focus for evaluation. However, such eva! uatee-evaluator 



* The authors are indebted to Dr. Richard Turner of Indiana University for 
his comments on this section* 
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agreement is aot always eabily obtained* 
Evaluator-Evaluatee Aereemen£ 

One common problem between director and ^valuator Is reflected in a 
conversation that one of the authors recently had with the director of a 
laboratory project. This individual spoke animatedly about the evaluation 
that his funding agency had imposed on him. He felt that the evaluators 
forced him to admit to objectives that he did not really have in order to 
effect a clean evaluation. Furthermore, he felt that one of his project staff 
members could tell him much more about the effectiveness of his materials 
after an hour with a class than could any amount of formal evaluation. 

One cause of such incompatibility between development and evaluation may 
be the fact that the evaluative criteria and even the evaluator were imposed 
on the project by its funding agency. Furthermoret some evaluators tend to 
lack flexibility in their approach* They tend to impose an established 
evaluation design onto a project rather than tailoring the design to the 
project and the audience* And frequently the project director has no interest 
at all in formal evaluation* His interest and energies are directed toward 
development t and his contact with the proj&ct materials completely satisfies 
his criteria for knowing that they are successful. For such a person the 
hours required to develop an effective evaluation are not going to be gladly 
given* 

It does not seem likely that a simple cure will be forthcoming for the 
problems mentioned above* One can do little more than call for consultation 
between funding agency and project director on evaluative criteria, flexibility 
and ingenuity on the part of the evaluator, and commitment to formal evaluation 
on the part of the project* There is, however* another problem which plagues 
evaluators and which can, under some conditions be dealt with* 
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Generally, formal evaluation is expensive* Evaluator8» assistants » 
tests, and computers all cost money and many projects* even if they have 
sufficient money, hesitate to spend it on evaluation. A partial practical 
solution to this money problem is the in*house development of an evaluator* 
Those projects that work within the framework of a university can employ a 
mathematics education graduate student who has an interest in evaluation* 
He can be involved in the development of the project; he can be trained 
by the evaluators on campus as part of his doctoral Vv/Ck; and he can effect 
the evaluation of the project with the consultation of one of the professional 
evaluators (possibly his thesis director)* This approach cuts costs, and 
seems to increase the likelihood of sensitive and open-minded evaluation 
without sacrificing validation by a professional evaluator. 
Need, for Coamunicatipn and Cooperation 

No one project is likely to afford clear articulation of affective 
and process goals, the development of sensitive instruments, and the 
creation of an acceptable design for evaluation. Projects must share their 
experiences and their instruments, and they must cooperate in the develop*- 
ment of better evaluation programs* 
Simary 

There are problems with mathematics laboratory evaluation, and the 
elimination of most of these problems seems a long way off* When one 
considers these problems and recalls that a certain number of Individuals 
are mystically or emotionally opposed to all evaluation* one may be 
disappointed but should not be terribly surprised that the list of mathe** 
matics laboratory evaluation projects is fairly short* 
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We have reported here on some laboratory evaluation projects that have 
been effective or that have introducad interesting techniques. We have 
discussed the need for clear articulation of goals, the need for the 
development of sensitive instruments» and the need for flexible leadership 
from professional evaluators. And we have hinted at Some possible steps 
toward these ends* 

Hopefully, the cooperation of many mathematics laboratory projects 
on these matters will improve the art of their evaluation. 
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